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ABSTRACT 


This  study  reports  the  results  of  a  secondary  analysis  of  two  years 
posthospitalization  data  from  2,950  subjects.  Subjects'  Alcoholics 
Anonymous  Attendance  and  aftercare  attendance  (test  variables)  were 
correlated  with  1 1  outcome  variables  suggestive  of  successful  adaptation 
to  their  chemical  abuse  problems.  A  model  conceptualized  subjects' 
outcome  performance  in  terms  of  the  interactions  among  eight  control 
variables,  reflecting  subject  characteristics,  and  the  test  variables. 
Bivariate  analyses  found  that  the  control  variables  were  unrelated  to  AA 
attendance,  weakly  related  to  aftercare  attendance  and  somewhat  more 
related  to  sobriety.  Sobriety  was  the  only  outcome  variable  significantly 
related  to  both  test  variables  across  time.  The  data  did  not  support  a 
multidimensional  model  of  outcome  performance,)  Cross-lagged  panel 
analysis  supported  the  hypothesis  that  the/correlation  between  AA 
attendance  and  sobriety  was  not  spurious.  Although  sobriety  did  effect  AA 
attendance,  AA  attendance  was  more  important  in  determining  sobriety. 
Cross-lagged  analysis  was  not  able  to  reject  a  null  hypothesis  that  the 
correlation  between  aftercare  and  sobriety  was  spurious.  AA  attendance 
was  the  most  Important  variable  selected  in  the  stepwise  regression  of 
sobriety  across  time.  Aftercare  was  selected  only  in  the  6-month  and  12- 
month  follow-up  intervals.  Taking  into  account  the  control  variables,  AA 
attendance  accounted  for  the  largest  portion  of  the  variance  in  sobriety. 
Aftercare  accounted  for  only  a  negligible  increase  In  the  explanation  of  the 
variance  in  sobriety.  The  adequacy  of  the  model  guiding  this  study  was 
questioned.  An  alternative  model,  based  on  the  results  of  this  study  was 
proposed.  *  ■  /-  ; .  -*/ 
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OVERVIEW 


The  introduction  provides  an  overview  of  the  study.  First,  a  number 
of  important  issues  In  the  alcoholism  treatment  field  are  discussed  briefly 
to  provide  contextual  understanding  and  grounding  of  the  rationale  for 
undertaking  this  study.  Second,  a  concise  purpose  statement  Is  presented 
followed  by  a  short  discussion  of  the  expected  contributions  of  this  study 
towards  the  advancement  of  knowledge.  The  final  section  of  the 
introduction  outlines  the  methodological  design  of  the  study,  provides  an 
explanation  for  the  purposive  sampling*  used  In  the  study,  and  introduces 
the  concept  of  directional  Inference  In  relation  to  correlational  designs. 

ESTABLISHING  THE  CONTEXT  OF  THE  STUDY 


Alcohol  abuse  and  alcoholism  have  been  described  as  multi-faceted 
phenomena  which  affect  the  social,  psychological,  and  biological  functioning 
of  persons  dealing  with  alcohol  problems  (Mendelson  and  hello,  1979; 


1  Purposive  sampling  "Is  a  form  of  nonprobablllty  sampling  which  is  characterized  by  the  use 
of  judgment  and  deliberate  effort  to  obtain  samples"  ( Ker linger ,  1 986,  p.  1 20).  "The  units  to  be 
observed  are  selected  on  the  basis  of  the  researcher's  own  judgment  about  which  ones  wold  be  most 
useful"  (Babble,  1986,  p.556). 


Poltch,  Armor,  and  Bralker,  198);  and  Valllant,  1983).  The  estimated 
societal  cost  for  these  alcohol-related  problems  in  the  United  States 
approached  $1 17  billion  in  1983,  the  latest  year  for  which  estimates  are 
available  (Cahalan,  1987).2 3 4  Currently  it  is  estimated  that  the  total 
"expenditures  for  alcoholism  treatment  in  the  United  States  exceed  $15 
billion  per  year"  (Bowen,  1987,  p.136). 

Prevalence  estimates  of  the  number  of  people  with  drinking  problems 
vary  significantly  depending  on  which  criteria  are  used  to  define  "drinking 
problems."  Bowen  (1987)  estimated  that  18  million  Americans,  aged  18  or 
older,  experience  alcohol-related  problems  (p.  12).  in  the  First  Special 


Report  to  the  U.S.  Congress  on  Alcohol  and  Health  In  1 97 1 ,  as  reported  in 
Cahalan  (1987),  It  was  estimated  that'Tive  percent  of  the  adult  population 
manifest  the  behaviors  of  alcohol  abuse  and  alcoholism"  (p.  17)3.4  Recent 
Journal  articles  have  pointed  to  significant  age,  gender,  and  ethnic  variation 
In  the  prevalence  of  alcohol  related  problems  (Caetano,  1984;  Lex,  1985;  and 
wilsnack,  wilsnack,  and  Klassen,  1985). 

To  discuss  "alcoholism  treatment"  begs,  to  some  degree,  an  important 
question  regarding  the  nature  of  the  problem.  While  one  continues  to  hear 
colloquial  and  informal  use  of  the  terms  "alcoholism"  and  "alcoholic",  a 


2  According  to  Bowen  (1987),  this  estimate  of  the  societal  cost  of  alcohol  related  problems  is 
not  directly  comparable  to  earlier  estimates  due  to  substantial  methodological  differences  in  the 
computation  of  the  estimate  ( p.  2 1 ). 

3  A  more  recent  estimate  of  the  prevalence  of  alcoholism  was  presented  by  Schucklt  ( 1 985) 
who  concluded  that  "between  5*  and  1 0*  of  the  adult  American  male  population  will  develop 
alcoholism  at  some  point  in  their  lifetime^  p.  xl).  Hilton  (in  press),  as  reported  in  Bowen 

( 1 987),  calculated  that  1 4%  of  male  and  68  of  female  drinkers  report  a  "moderate  amount  of 
tangible  consequences  from  their  drinking"  ( p.  12). 

4  Based  on  data  collected  at  three  sites  of  the  Epidemiological  Catchment  Area  program ,  lifetime 
prevalence  rates  of  alcohol  abuse/  dependence  for  males  were  estimated  between  1 9. 1  %-  28.9%. 
The  lifetime  prevalence  rates  for  females  were  estimated  between  4.2%  -  4.8%  (Robins,  Helzer, 
Welssman, Orvaschel,  Oruenberg,  Burke,  and  Regier,  1 984,  p.  954). 
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review  of  the  current  clinical  and  research  literature  regarding  alcohol 
problems  reinforces  the  position  taken  by  Wanberg  and  Horn  (1983)  that 
"alcoholism  is  not  a  unitary  phenomenon  and  that  multiple  syndromes  are 
necessary  to  describe  persons  with  alcohol-related  problems"  (p.  I055).5 
While  the  heterogeneity  of  alcohol  problems  Is  evident  and  increasingly 
addressed  in  the  literature,  the  dividing  lines  between  "people  with  alcohol 
problems",  “alcohol  abuse",  "alcohol  dependence“and  "alcoholism"  remain,  for 
the  most  part  (and  not  withstanding  DSM-lll-R6)  remarkably  subjective.7 

Although  definitional  issues  are  rife,  there  is  a  consensus  that,  for 
most  people  who  are  formally  diagnosed  as  being  alcoholic,  resolving  the 
alcohol-related  problems  involves  a  long-term  process  of  coming  to  terms 
with  the  chronlclty  of  their  alcohol  problems.  Rather  than  achieving  a 
"cure"  for  a  discrete  illness,  current  treatments  emphasize  lifestyle 
adjustment  to  a  chronic  condition  which  can  Include  (and  often  recommend) 
extensive  use  of  social  support  networks,  such  as  Alcoholics  Anonymous 
(AA)  meetings  or  formal  aftercare  treatment  groups  (Favazza  and  Thompson, 
1984). 

This  study  approaches  the  subject  of  alcoholism  intervention  recog¬ 
nizing  the  necessity  of  lifestyle  adjustment  to  a  chronic  condition.  While 
lengthy  periods  of  "remission"  are  possible  and  desirable;  recovery  from  al¬ 
coholism  is  also  likely  to  Include  periodic  relapses  Into  problematic  drlnk- 


5  In  contrast,  Valllent  ( 1 983)  prefers  to  view  severe  alcohol  abuse  as  "reflecting  a  relatively 
unitary  disorder  that  results  from  the  coming  together  of  multiple  etiological  risk  factors 

(p.  45). 

6  American  Psychiatric  Association  ( 1 987 ).  Diagnostic  and  Statistical  Manual  of  Mental 
Disorders  (Third  Edition-  Revised).  Washington  D.C.:  American  Psychiatric  Association. 

7  Met2ger  ( 1 988)  notes  that  there  have  been  hundreds  of  definitions  of  alcoholism  "presented 
by  specialists  in  the  field"  with  no  agreement  among  them  ( p.  8).  "There  has  never  been  a 
universally  accepted  definition  of  alcoholism"  (NASW,  1987,  p.  133). 


ing.8  The  multl-determtned  model  of  alcoholism,9  upon  which  this  study  is 
based,  relies  on  a  health  metaphor10  which  reflects  an  appreciation  of  the 
Interactive  relationships  among:  predisposing  factors,  exposure,  social 
learning,  mitigating  circumstances,  and  resulting  behaviors. 

A  substantial  portion  of  the  published  literature  in  the  alcohol 
treatment  field  is  devoted  to  demonstrating  treatment  Impact  and  efficacy 
(Emrlck,  1975).  While  this  emphasis  is  understandable  In  terms  of  quality 
assurance  Issues  and  limited  resources.  It  has  had  the  untoward  effect  of 
narrowing  the  focus  and  shifting  the  emphasis  of  research  away  from  the 
chronic  nature  of  alcohol  problems.  Focusing  on  the  short-term  response  to 
treatment  has  tended  to  mask  the  complexity  and  chronlclty  of  alcohol 
related  problems.  For  the  most  part,  the  Issues  of  short-term  versus  longer 
term  prognoses  remain  to  be  studied. 

Another  Influencing  factor  on  current  research  can  be  seen  in  the 
social  policy  literature  regarding  alcohol  problems.  Of  particular  interest 
Is  the  effect  of  the  current  governing  Images11  on  the  definition  of  alcohol 
problems  and  which  interventions  are  being  viewed  as  appropriate  for 


8  Relapse  into  problematic  drinking,  particularly  following  "successful"  treatment  is 
considered  by  Marlatt  and  Gordon  ( 1 985)  to  "characterize  the  addictive  disorders"  ( p.  lx). 

Recent  research  has  demonstrated  that  "relapse  into  alcoholic  drinking  reflects  conditioned 
behavior,  not  a  capricious  desire  or  a  simple  response  to  psychological  conflict"  ( Vatllant,  1 983, 
p.  177). 

9  Valllant  ( 1 983)  sees  alcoholism  defined  "by  the  number  and  frequency  of  alcohol -related 
problems",  not  just  the  presence  or  absence  of  specific,  commonly  accepted  signs  and  symptoms 
(p.  35). 

1 0  As  Involving  a  state  of  "complete  physical ,  mental ,  aid  social  well-being  and,  according  to 
the  World  Health  Organization,  not  merely  the  absence  of  disease  or  infirmity"  (Barker,  1 987, 
p.  69) 

1 1  Governing  Images  refer  to  “shared  simplifications"  involving  "widespread  understanding 
and  acceptance."  A  "bod/  of  conventional  wisdom"  which  focuses  attention  on  those  aspects  of  a 
problem ,  deemed  by  society,  to  be  most  important.  The  governing  images  are  "so  powerful  and 
seem  so  much  a  part  of  our  current  society,  it  Is  hard  to  ask  effective  and  probing  questions  about 
their  limitations"  (Moore and Gerstein,  1981 ,  pp.  6-  15). 


problem  resolution  (Moore  and  Gerstein,  1981).  The  alcoholism  treatment 
field  can  be  differentiated  from  other  health  care  areas  by  the  degree  to 
which  ideology  influences  treatment  decisions.12  For  example,  although  the 
available  empirical  data  Is  clearly  equivocal  regarding  the  value  of 
aftercare  programming,  most  treatment  programs  lend  whole-hearted 
support  to  the  concept  of  some  type  of  sustained  aftercare  effort  on  the 
part  of  their  clients.13 

To  this  end,  a  number  of  treatment  programs  offer  specific,  time 
limited  outpatient  programs  to  facilitate  posthospitalization  adjustment. 
Similarly,  Alcoholics  Anonymous  (AA)  stresses  the  importance  of 
developing  a  long-term  relationship  with  AA  as  a  support  group  for  the 
recovering  alcoholic's  personal  program  for  maintaining  sobriety. 

Combining  these  two  "beliefs",  In  the  absence  of  strong  empirical 
confirmation,  a  number  of  treatment  programs  utilizing  the  AA  philosophy14 
often  make  explicit  In  their  discharge  Instructions  the  expectation  that 
clients  follow-up  with  AA  as  well  as  attend  aftercare. 

The  two-year  time  period  immediately  following  subjects'  discharge 
from  Inpatient  chemical  dependency  treatment  facilities  has  been  shown  not 
to  be  a  particularly  stable  time.  Research  has  demonstrated  that  subjects 
tend  to  experience  many  "ups  and  downs"  across  this  time  period  (Pollch, 
Armor,  and  Bralker,  1981;  Pettlnatl,  Sugerman,  DlDonato,  and  Maurer,  1982, 
and  Bratter  and  Forest,  1985).  Intuitively,  it  would  seem  that  relative 

1 2  For  the  Impact  of  ideology  on  treatment  decisions  see  Tournler  ( 1 979)  and  the  responses  to 
his  article  which  were  published  in  the  same  Issue  of  the  journal. 

1 3  As  recent  as  January,  1 987 ,  Secretary  of  Health  and  Human  Services  Bowen  noted  that 
"aftercare  services  are  a  critical  component.. .and  considered  essential"  ( p.  1 33). 

1 4  The  term  "AA  philosophy"  refers  to  the  "Twelve  Steps"  of  AA  which  offer  a  logically  intuitive 
means  of  structuring  one’s  life  to  stop  the  use  of  alcohol  and  identify  and  make  necessary  changes 
In  relevant  behaviors,  attitudes  and  relationships.  See  Alcoholics  Anonymous  ( 1 952). 


adjustment  during  this  time  period  could  be  enhanced,  in  part,  by  the 
clients'  abilities  or  efforts  to  make  use  of  available  supportive  resources 
such  as  aftercare  groups  and  AA.  From  a  different  perspective,  Costello, 
(1975)  found  that  the  provision  of  aftercare  was  one  of  the  seven 
characteristics  which  distinguished  successful  from  unsuccessful 
treatment  programs  (p.  857). 

A  final  issue  which  has  been  the  subject  of  much  discission  for  the 
past  26  years  is  the  measurement  of  outcome.  How  is  the  response  to 
treatment  established?  Early  research  focused  on  abstinence  from  further 
consumption  of  alcohol  as  an  important,  and  for  the  most  part,  only  measure 
of  outcome.15  Beginning  with  Davies'  (1962)  observation  that  some 
alcoholics  appeared  to  be  able  to  resume  successful  social  drinking,  the 
adequacy  of  abstinence  as  an  outcome  measure  has  been  subject  to  much 
inquiry.  The  debate  about  the  pros  and  cons  of  the  abstinence  issue  has 
taken  on  the  appearance  of  a  pendulum  effect.  Most  recently,  as  Secretary 
of  Health  and  Human  Services,  Bowen  (1987)  concluded  that  “abstention 
from  alcohol  and  other  psychoactive  drugs  continues  to  be  the  most 
reasonable  treatment  goal  for  diagnosed  alcoholics  In  light  of  current 
scientific  and  clinical  Information"  (p.  136). 


15  For  a  balanced  discussion  of  the  "abstinence  issue"  see  Bean  and  Zimberg  ( 1 98 1 )  or  Moore 
andGerstein  (1981). 


With  relatively  few  exceptions,  when  clients  complete  Inpatient 
chemical  dependency  treatment,  they  are  encouraged  to  attend  both 
aftercare  and  AA  meetings.16  This  study  attempted  to  look  at  the 
relationships  between  the  subjects’  reports  of  attending  aftercare  and  aa 
meetings  and  the  subjects’  responses  to  a  number  of  outcome  measures 
reflective  of  successful  adaptation  to  their  chemical  dependency  problems. 
Does  attending  an  aftercare  program17  Influence  subsequent  outcome?  Is 
there  a  correlation  between  “active"  AA  attendance18  and  subsequent 
outcome  functioning?  Is  there  a  synergistic  or  additive  effect  for  clients 
who  participate  In  both  aftercare  programs  and  AA  In  terms  of  outcome? 


16  In  the  case  of  the  stud/  sample,  94.38  of  the  subjects  were  referred  toM.  In  contrast, 
73.48  of  the  subjects  were  referred  to  aftercare.  The  smaller  percentage  of  aftercare  referrals 
was  due  to  some  subjects  having  been  discharged  to  locations  where  aftercare  was  unavailable. 
Categorizing  the  subjects  in  terms  of  their  proximity  to  aftercare,  no  significant  differences  were 
noted  In  terms  of  either  aftercare  attendance  or  AA  attendance.  A  number  of  treatment  centers 
reported  to  the  author  that  they  attempted  to  refer  clients  who  lived  at  a  distance  from  their 
program  to  other  aftercare  programs  in  the  area  in  which  the  clients  lived. 

1 7  "Aftercare"  refers  to  the  widely  accepted  practice  of  providing  a  time-  limited  period  of 
transitional  support  to  clients  who  are  being  discharged  from  inpatient  chemical  dependency 
treatment.  Mok  aftercare  Involves  weekly  group  sessions  structured  around  the  *  isks  of 
maintaining  sobriety.  Aftercare,  unlike  self-help  groups,  Involves  a  fee-for-service,  paid 
directly,  or  included  Indirectly  as  part  of  a  package  deal  for  combined  inpatient  and  follow-up 
services.  Aftercare  groups  are  staffed  by  or  supervised  by  professional  alcohol  counselors  as 
opposed  to  self-help  groups,  whose  leadership  comes  from  the  ranks  of  the  membership.  See 
Chapter  6  for  a  discussion  of  the  limitations  regarding  this  variable. 

1 8  AA  attendance  refers  to  clients'  self-reports  of  attending  Alcoholics  Anonymous  meetings.  AA 
Is  a  well  established  self-help  group  for  recovering  alcoholics.  Current  United  States 
membership  Is  reported  as  630,700  (AA  world  Services,  1 984).  Other  than  periodic  surveys, 

AA  maintains  no  membership  lists,  nor  are  there  any  requirements  for  membership  other  than  a 
desire  to  not  drink.  There  are  many  anecdotal  reports  regarding  the  positive  contributions  of  AA  to 
clients.  Direct  stud/  of  the  organization  has  been  hampered  by  a  number  of  methodological 
problems. 
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Practice  wisdom,  buttressed  by  anecdotal  accounts,  would  suggest 
that  some  type  of  aftercare  Involvement  Is  preferable  to  no  involvement. 

For  the  most  part,  previous  empirical  studies  have  tended  to  focus  on 
aftercare  involvement  and  AA  participation  as  either  dependent  variables 
reflecting  a  positive  treatment  outcome19,  or  as  Independent  variables,  but 
combined  with  other  treatment  elements,  as  part  of  a  combined  treatment 
effect  (Emrlck,  1975;  Finney,  Moos,  and  Mewbom,  1980;  Pettlnatl,  et  al., 

1 982;  and  Ornsteln  and  Cherepon,  1 985). 

In  contrast  to  the  above,  this  study  looks  at  aftercare  and  aa 
attendance  following  discharge  from  Inpatient  chemical  dependency 
treatment  as  important  predictor  variables  In  terms  of  their  correlation 
with  the  outcome  variables.20  Understanding  the  multidimensional  aspects 
of  recovery  from  alcoholism,  a  number  of  indicators  of  outcome  were 
selected.  Sobriety,  the  ability  to  maintain  abstinence  from  alcohol  and 
other  drugs,  was  Included  as  an  outcome  measure.  The  author's  clinical 
experience21  suggested  that  since  problematic  drinking  was  at  the  heart  of 
the  Issue,  abstinence  from  further  use  of  alcohol  and  drugs  should  be  an 
exceptionally  salient  outcome  variable. 

This  study  makes  a  contribution  to  the  advancement  of  knowledge  in  a 
number  of  ways.  First,  while  Inferences  have  been  drawn  about  possible 
interactive  relationships  between  aftercare  and  AA  attendance,  this  Is  the 

19  As  a  dependent  measure ,  aftercare  attendance  or  AA  attendance  would  be  considered  signs  of  a 
successful  adjustment  and  positive  outcome. 

20  The  term  "predictor  variable"  Is  synonymous  with  the  term  "Independent  variable."  In  this 
study  the  Independent  variables  have  been  classified  as  either  "control  variables"  or  "test 
variables."  The  term  "test  variables"  is  used  frequently  within  the  study  to  replace  the  awkward 
repetition  of  the  phrase  "AA  attendance  and  aftercare  attendance."  The  term  "test  variables"  will 
always  refer  to  both  AA  attendance  and  aftercare  attendance. 

2 1  The  author  served  as  the  Assistant  Director  of  the  U.S.  Air  Force  Medical  Center's  Alcoholism 
Rehabilitation  Center  In  Wiesbaden,  West  Germany,  1 982-  1 985. 


first  study,  to  the  author's  knowledge,  to  systematically  explore  the 
relationships  between  these  two  variables  and  their  relative  contributions 
to  outcome. 

Second,  the  sample  selected  for  this  study  consisted  of  subjects  who 
were  considered  to  be  relatively  "high-functioning"22,  and  consequently, 
would  be  more  representative  of  mainstream  America  than  many  of  the 
other  studies  which  focus  almost  exclusively  on  either  indigent  or 
chronically  disabled  populations  23  Studying  "successful  adaptation"  in  the 
latter  settings  is  neither  reflective  of  the  experiences  of  the  majority  of 
clients  who  go  through  chemical  dependency  treatment  and  remain 
functional,  nor  particularly  relevant  for  understanding  how  higher 
functioning  groups  utilize  supportive  services  In  the  maintenance  of  their 
.  ji  rlety. 

Third,  the  focus  of  the  study  Is  exploratory  in  nature  and  reflects  a 
strong  commitment  to  empirically  describing  relationships.  Rather  than 
accepting  the  status  quo  and  "obvious",  which  tend  to  be  heavily  biased  by 
Ideological  concerns,  this  study  proposes  to  ask  basic  questions  regarding 
the  relationship  between  aftercare,  AA  attendance,  and  subsequent  outcome. 
Through  a  secondary  analysis  of  a  large  data  pool  (N  =  2,950),  the  goal  of  the 
study  was  to  extend  our  understanding  of  the  relationships  between  the  test 
variables  and  selected  outcome  variables.24 

22  The  majority  of  subjects  In  this  sample  had  completed  at  least  1 2  years  of  education  and,  for 
the  most  part,  were  employed. 

23  A  recurring  theme  In  the  literature  reviews  of  alcoholism  treatment  is  the  narrow  focus  of 
most  research  samples  from  which  global  conclusions  tend  to  be  made.  For  the  most  part,  our 
current  understanding  of  alcoholism  treatment  tends  to  be  b8sed  on  relatively  small  samples  of 
white  males  drawn  from  Veterans  Administration  Medical  Center  populations,  which  tend  to  be  less 
functional ,  more  disabled,  and  significantly  older ,  than  mainstream  America. 

24  The  secondary  analysis  was  guided  by  a  model ,  developed  from  a  review  of  the  literature  and 
the  author's  clinical  experience,  which  hypothesized  relationships  between  the  test  variables, 


Fourth,  the  use  of  bivariate  analyses  with  cross-lagged  panel 
analyses,  multiple  regression  analyses,  and  a  linear  discriminant  analysis, 
substantially  added  to  our  understanding  of  the  relationships  among  the 
study  variables,  For  the  most  part,  data  analysis  within  the  alcoholism 
treatment  field  has  remained  fairly  rudimentary,25  The  increased 
sophistication  of  the  design  of  this  data  analysis  enhanced  the  credibility  of 
the  findings  through  the  use  of  "data  analytic  procedures  which  were  well 
established  and  considered  to  be  the  methods  of  choice  In  psychology  and 
other  social  and  behavioral  sciences"  (Bentler,  Lettlerl,  and  Austin,  1976, 


control  variables,  and  outcome  variables.  See  'Table  5:  Hypothetical  Model  of  the  Relationships 
Among  the  Test  variables,  Sobriety,  and  Other  Variables  Suggested  by  a  Revtew  of  the  Literature" 
In  the  third  chapter, 

25  Shucklt  ( 1 985)  observed  that  many  "empirically  minded  researchers  shun  research  in  this 
area,"  due  primarily  to  the  presence  of  many  methodological  problems  ( p.  xll)  Certainly  one 
reason  for  this  situation  Is  a  reluctance  to  ask  hard  questions  which  may  challenge  beliefs  or  the 
governing  Images, 


The  centra’  questions  of  this  study  look  at  the  relationship  between 
aftercare  and  AA  attendance,  and  whether,  as  test  variables,  they  correlated 
with  selected  outcome  variables.  The  research  questions  were  addressed 
through  a  secondary  analysis26  of  a  subgroup  of  a  larger  population  of 
subjects  who  had  been  followed,  with  varying  degrees  of  success,  for  a 
two-year  period  following  their  discharge  from  chemical  dependency 
treatment  programs. 

The  Intent  of  the  study  was  to  clearly  explicate  the  relationships 
among  variables  within  the  selected  sample.  For  this  reason,  the  sample  of 
subjects  for  this  study  was  limited  to  subjects  for  whom  as  much 
information  as  possible  was  available.  The  underlying  rationale  for  this 
approach  was  to  maximize  the  probability  of  explicating  the  relationships 
among  variables.  Consequently,  It  was  expected  that  the  data  from  the 
subgroup  of  subjects  analyzed  in  this  study  might  differ  in  some  respects 
from  other  subgroups  of  subjects  drawn  from  the  larger  population  which 
were  missing  data  from  one  or  more  follow-up  interviews.27 

Data  from  a  sample  chosen  to  maximize  available  knowledge  about  the 
subjects,  could  be  used  at  a  later  date  as  a  baseline  for  the  purposes  of 
comparison  with  other  samples  with  varying  degrees  of  available 
Information  about  their  subjects.  Through  a  conscious  limiting  of  the  scope 

26  Kruzlch  (1981)  documented  the  importance  of  secondary  analysis  of  extant  data  for  the 
purpose  of  addressing  longitudinal  questions  ( p.3), 

27  This  point  was  underscored  by  Mackenzie, Funderburk,  Allen,  and  Stefan  ( 1 987)  who  found 
that  subjects  for  whom  data  were  lost  were  difficult  to  interview  rather  than  difficult  to  locate, 
the  former  of  which  correlated  with  worse  drinking  outcome  ( p.  1 1 9). 


of  the  population  under  the  study,  It  was  expected  that  the  enhanced 
understanding  of  relationships  among  the  variables  would  offset  any 
limitation  In  terms  of  the  generalization  of  the  findings. 

One  of  the  difficulties  In  the  Interpretation  of  a  correlational  design 
Is  the  Issue  of  ruling  out  alternative  explanations  for  observed 
relationships  (Carmines  and  Zeller,  1979).  In  particular,  one  may  ask  If  the 
observed  relationship  between  attending  aftercare  and/or  AA  attendance 
and  the  clients'  measure  on  an  outcome  variable  Is  spurious.  Perhaps  the 
observed  relationship  simply  reflects  higher  levels  of  motivation  for 
resolving  the  alcohol  related  problems.  Rather  than  AA  attendance  or 
aftercare  attendance,  the  underlying  factor  might  be  one  of  differential 
motivation. 

Looking  at  the  possible  relationships  between  AA  attendance  and 
abstinence  from  alcohol,  for  example,  one  can  clearly  see  the  dilemma.  A 
large  correlation  coefficient  between  the  two  variables  could  be  accounted 
for  by  at  least  two  opposing  hypotheses.  The  first,  and  perhaps  more 
intuitive  explanation  Is  that  attendance  at  AA  meetings  could  provide  a 
strong  reinforcement  for  maintaining  sobriety.  In  this  respect,  AA 
attendance  might  be  thought  of  as  Influencing  sobriety.  An  equally  valid 
alternative  Interpretation  of  the  relationship,  however,  Is  that  people  who 
are  able  to  maintain  their  sobriety  are  also  attracted  to  AA  groups.  From 
this  perspective,  sobriety  could  be  said  to  influence  AA  attendance.  Recent 
advances  In  data  analysis  techniques  allow  for  beginning  directional 
Inferences  to  be  made  from  correlational  data.28.  This  study  will  use  cross- 

28  For  an  detailed  discussion  of  crossed-  lagged  panel  analysis  procedures  see  Rozelle  and 
Campbell  ( 1 969) ,  Goodman  ( 1 973) ,  and  Kenny  ( 1 975). 


lagged  panel  analysis  to  both  comment  on  hypothesized  directionality  in  the 
relationships  between  test  variables  and  outcome  variables,  and  assess  the 
probability  that  the  observed  relationships  are  spurious. 

The  design  of  this  study  involved  a  secondary  analysis  of  extant  data 
which  explored  the  relationships  between  attending  aftercare  programs 
and/or  AA  meetings,  and  a  variety  outcome  measures.  A  number  of  variables, 
previously  Identified  In  the  literature  as  germane  were  controlled  for  In 
this  analysis.  The  variables  were  looked  at  first  in  terms  of  their  bivariate 
relationships.  Second,  building  on  the  work  of  Vanlcelll  (1978)  and  Costello 
( 1 980)  cross-lagged  panel  analysis  was  used  to  address  possible 
directionality  In  the  correlation  between  predictor  variables  and  relevant 
criterion  variables,  and  rule  out  the  possibility  that  the  observed 
relationships  were  spurious  rather  than  real.  Third,  through  multiple 
regression  analyses,  the  previously  described  model  was  tested  to  see 
whether  the  addition  of  aftercare  and/or  AA  variables  to  the  regression 
equation  improved  Its  explanatory  power  over  that  provided  by  the  only 
control  variables  for  predicting  the  outcome  variables.  In  combination  with 
a  cross-validation  of  the  multiple  regression  results,  a  discriminant 
analysis  was  used  In  the  last  step  of  the  design  to  assess  the  efficacy  of 
the  model  chosen  to  guide  the  secondary  data  analysis 

This  chapter  has  presented  an  overview  of  the  context,  purpose,  and 
design  of  this  study.  Through  a  sophisticated  secondary  analysis  of  data 
collected  from  subjects  who  were  discharged  from  chemical  dependency 
treatment,  the  goal  of  the  study  was  to  explicate  the  relationships  between 
attending  aftercare,  AA  attendance,  and  their  correlations  with  outcome 
variables  over  a  two-year  time  period,  In  a  practice  field  dominated  by 
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ideological  concerns,  the  empirical  perspective  of  this  study  was  thought  to 
De  particularly  germane.  The  next  chapter  will  discuss  a  review  of  the 
literature  upon  which  this  analysis  was  based. 
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The  literature  review  has  been  divided  into  six  sections  in  order  to 
address  the  complexity  of  the  literature  in  this  field.  After  providing  a 
brief  overview  of  the  literature  reviewed  for  this  study,  the  second  section 
will  summarize  relevant  findings  from  the  treatment  outcome  and  program 
evaluation  literature.  The  third  and  fourth  sections  will  address  specific 
findings  from  a  review  of  articles  discussing  aftercare  attendance  and  AA 
participation.  The  fifth  section  will  summarize  the  literature  from  studies 
which  looked  at  self-help  groups  and  social  support.  The  sixth  section  will 
provide  an  overview  of  a  number  of  methodological  and  design  concerns 
reported  in  the  recent  literature.  The  final  section  of  the  literature  review 
will  discuss  issues  of  validity  and  reliability  relevant  for  this  study. 

OVERVIEW  OF  THE  LITERATURE  REVIEW 


A  review  of  the  literature  provides  Insight  regarding  the  conceptual 
and  methodological  issues  with  which  researchers  have  had  to  struggle. 
Clinical  intuition,  treatment  ideology  and  methodological  requirements  tend 


to  mix  rather  uncomfortably.1  Consensus  Is  achieved  in  a  negative  sense  in 
terms  of  agreement  regarding  methodological  and  conceptual  limitations. 

As  will  be  discussed  below,  for  most  of  the  subject  areas,  the  only 
consensus  Is  that  there  Is  no  consensus. 

Heckler  (1983)  has  observed  that  "treatment  research  Is  passing 
through  a  transitional  period  during  which  the  basic  assumptions  are  being 
reevaluated"  (p.  1 15).  Certainly  this  study  has  been  undertaken  with  an 
appreciation  of  this  perspective.  Heckler's  comments  are  viewed  as 
“permission”  to  stop,  take  stock  and  actively  question  what  previously  has 
been  accepted  as  obvious. 

In  addition  to  conceptual  and  methodological  limitations  noted  above, 
another  possible  explanation  for  the  absence  of  consensus  in  the  research 
findings  results  from  attempting  to  bend  empirical  findings  to  fit 
preconceived  notions  about  how  things  ought  to  be,  rather  than  questioning 
the  hypotheses  which  do  not  fit  the  resulting  data.  This  study  focuses  on 
several  Issues  which  sit  at  the  heart  of  much  of  the  discussion  regarding 
basic  assumptions  about  the  roles  of  aftercare,  AA,  and  what  constitutes 
appropriate  outcome  measures. 

As  a  starting  point,  consider  Vorls'  (1981-  82)  comments  about 
methodological  Issues  addressed  in  two  classic  literature  reviews, 
published  more  than  twenty  years  apart  in  19422 3  and  1967,3  respectively. 
Both  studies  reached  the  same  conclusion  that  it  was  "impossible  to  form 

1  The  alcoholism  treatment  field  is  somewhat  unique  in  terms  of  utilizing  a  large  corps  of 
recovering  clients  to  provide  paraprofessional  treatment  services.  The  recovering  staff  members 
tend  to  ground  their  expertise  and  knowledge  in  terms  of  their  personal  experience  with 
alcoholism  rather  than  in  empirically  based  findings. 

2  See  Voegtlin  and  Lemere(  1942). 

3  See  Hill  and  8  lane  ( 1967). 


any  sort  of  opinion  about  the  value  of  treatment  from  an  examination  of  the 
literature  alone"  (p.  550).  In  a  more  recent  literature  review  updating  the 
earlier  findings,  Oordls,  Dorph,  Sepe,  and  Smith  (1981)  were  able  to 
continue  to  conclude  that  "global  conclusions  about  outcome,  based  on  the 
literature  are  Impossible"  (p.  521). 

At  the  heart  of  much  of  this  discussion  are  problems  with  definitions 
of  predictor  and  criterion  variables,  competing  theoretical  models,  and 
relative  absence  of  consistently  significant  findings.  For  all  the  above 
reasons,  the  chemical  dependency  treatment  field  has  been  in  a  rather 
unenviable  position  of  not  being  able  to  empirically  confirm,  for  the  most 
part,  that  their  contributions,  efforts,  and  concomitant  societal  costs, 
result  In  substantial  benefits  for  either  their  clients  or  the  community  at 
large.4 

The  complexity  of  this  literature  review  resulted  from  the  number  of 
topical  areas  which  needed  to  be  reviewed  In  order  to  place  the  subject  of 
this  study  within  Its  proper  context.  Having  completed  the  literature 
review,  it  Is  the  author’s  observation  that  what  was  missing  was  a  general 
model  to  provide  an  overall  structure,  within  which  the  many  relationships 
among  topics  addressed  or  referenced  in  this  study  could  be  explored.  Part 
of  this  difficulty  may  have  been  related  to  our  tendency  to 
compartmentalize  topics  rather  than  see  things  In  terms  of  their 
commonality. 

4  Prof.  James  Klncannon  ,  In  a  class  discussion ,  made  the  observation  that  regardless  of  what 
particular  predictor  variable  was  studied,  it  would  ultimately  explain  about  six  percent  of  the 
variance  In  whatever  criterion  variable  was  being  studied.  He  named  this  observation 
"Kincannon's  Law  of  Six  Percent."  His  comments  presented  in:  Public  Health  5047: 

Intervention/  Secondary  Prevention  of  Drug  Abuse  in  Adults,  Spring  Quarter ,  1 987. 


Emrick  (1975)  reviewed  a  large  number  of  outcome  studies  and 
concluded  that  “few  significant  long  term  differences  could  be  found  when 
comparing  treatment  with  no  treatment  groups"  (p.  91 ).  One  explanation  for 
the  absence  of  “long  term  differences"  may  be  found  in  terms  of  the 
theoretical  perspectives  taken  by  the  researchers.  As  noted  above, 
Ideological  predisposition  has  tended  to  cloud  the  picture.  One  example  of 
this  can  be  seen  in  the  number  of  studies  which  persist  in  narrowly  defining 
success  In  terms  of  long  term,  never  interrupted  sobriety. 

A  number  of  studies  have  concluded  that  intervention  into  alcohol 
problems  does  not  produce  a  significant  lasting  effect,  because  relatively 
few  clients  achieve  long  term,  stable  sobriety,  however  defined  (Pollch, 
Armor,  and  Braiker,  1981;  Gottheil,  Thornton,  Skoloda  and  Alterman,  1982; 
and  Vaillant,  1983).  In  direct  contrast,  the  author  was  impressed  by  the 
many  successful  anecdotal  accounts  published  in  the  literature  for 
recovering  alcoholics,  or  in  the  "war  stories"  told  and  retold  at  AA 
meetings.5  While  the  amount  of  continuous,  never  Interrupted  sobriety  was 
rarely  discussed  In  the  literature  or  the  meetings,  the  positive  description 
of  periods  of  sobriety  was  quite  noticeable.  Particularly  relevant  for  this 
discussion  were  the  anecdotal  observations  in  which  Identified  changes  in 

5  The  author  attended  a  number  of  Open  AA  meetings  within  the  Twin  Cities  area  to  gain  an 
experiential  understanding  of  the  dynamics  and  mechanics  of  AA  meetings.  The  membership  was 
advised  that  the  visits,  during  the  Fall  and  Winter  Quarters,  1 987,  were  for  the  purpose  of 
educating  the  author.  The  visits  were  congruent  with  AA’s  position  of  providing  open  meetings  so 
that  Interested  persons  may  learn  about  alcoholism  and  how  to  stop  drinking  (AA  World  Services, 
1975,  pp.  77-  80) 


patterns  over  time  were  noticed  where  periods  of  sobriety  were  increasing 
in  length  while  relapses  were  shorter  and  easier  to  control. 

One  of  the  problems  researchers  have  encountered  is  that  empirically 
derived  data  does  not  appear  to  support  the  concept  of  success  as  defined  by 
the  requirement  of  the  need  to  maintain  long-term  sobriety.  Instead, 
Schucklt,  Schwel,  and  6old  (1986)  note,  the  natural  course  for  the  average 
alcoholic  involves  a  "cyclic  pattern^  alternating  between  periods  of  problem 
drinking,  abstinence,  and  moderate  drinking  with  few  problems"  (p.  151 ). 
This  variety  and  fluidity  in  behavioral  performance  is  obscured  in  the 
interpretation  of  the  data, In  part,  by  ideological  blinders  of  expectation. 

For  example,  Gotthell  et  al.  (1982)  found  that,  while  abstinence  was  the 
most  desirable  treatment  outcome  because  subjects  who  abstained  from 
alcohol  did  better  at  each  follow-up  period,  only  about  ten  percent  of  their 
sample  was  able  to  be  "persistently  abstinent"  (p.  564)7 

In  part,  the  problem  is  also  related  to  the  use  of  research  designs 
which  look  at  outcome  either  cross-sectional ly,  or  longitudinally  using  only 
two  data-gatherlng  points.  If  the  researcher  gathers  data  for  a  two-year 
follow-up  period  at  only  one  or  two  data  gathering  points,  it  is  quite  likely 
that  the  considerable  movement  between  drinking  and  sober  categories  will 
be  missed.  Pettinatl,  Sugerman,  DiDonato,  and  Maurer  (1982)  label  this 
phenomenon  "window  viewing",  l.e.,  looking  at  an  "individual's  life  at  only 
one  point  In  time"  (p.  201).  In  their  four-year  follow-up  of  clients,  they 
found  that  only  about  29%  of  their  subjects  were  able  to  maintain 

6  This  finding  contradicts  the  position  taken  by  AA  that  untreated  alcoholism  involves  an 
Inexorable,  unidirectional  progression  towards  ever  increasing  severity  and  ultimate  mortality. 

7  The  author  notes  parenthetically  that  whether  these  findings  are  to  be  Interpreted  positively 
or  negatively,  depends,  for  the  most  part,  on  one’s  theoretical  position  rather  than  the  relative 
merits  of  the  data  or  any  intrinsic  validity  or  "truthfulness”  to  be  found  in  the  data. 


consistent  patterns  of  abstinence  and  consistent  adjustment  in  terms  of  an 
absence  of  behavioral  problems,  The  majority  of  their  subjects  tended  to 
fluctuate  between  good  adjustment  and  further  problems.8 

Much  of  the  outcome  literature  has  focused  on  either  client 
characteristics  or  characteristics  of  treatment  programs,  both  of  which, 
taken  together,  have  tended  to  explain  only  a  small  portion  of  the  total 
variance  in  the  criterion  variables.  (Adamson,  Fostakowsky  and  Cheblb, 

1 974;  Bromet  and  Moos,  1979;  Kruzlch,  1980;  Elal-Lawrence,  Slade  and 
Dewey,  1986,  1987).  In  the  search  for  additional  variables  which  might 
further  enhance  our  understanding  of  outcome,  researchers  have  turned  to 
posttreatment  and  environmental  factors  (Bromet  and  Moos,  1977;  Cronkite 
and  Moos,  1980;  Finney,  Moos  and  Mewborn,  1980).9 

Reframing  the  issue,  It  appears  to  the  author  that  social  support,  as 
an  environmental  factor  (the  availability  of  which  is  common  to  discussions 
of  client  characteristics,10  treatment  programs,  and  postreatment 
experiences),  may  play  an  important  role  In  determining  outcome.  A  common 
theme  in  families,  employment,  aftercare,  and  AA  attendance,  etc.,  is  the 
availability  of  a  supportive  structure  or  social  network  which  can  act  as  a 


8  The  author  notes  that  the  Issue  of  the  length  of  follow-up  interval ,  for  the  most  part,  has  not 
been  addressed  in  the  literature,  Pettinati  et  al.  ( 1 982)  describe  the  impact  of  "window  viewing 
but  used  annual  follow-up  Intervals  In  their  four  yea'  longitudinal  study.  Hoffmann  and  Harrison 
( 1 986)  is  one  of  the  few  studies  which  combined  frequent  follow-up  intervals  ( every  six 
months)  with  sufficient  length  of  time  (two  years  follow-up)  to  comment  on  longitudinal  trends 
with  some  degree  of  confidence  that  fluctuation  in  behavioral  changes  will  have  been  identified. 

9  Walker ,  Sanchez-Craig,  and  Bornet  ( 1 982)  found  pretreatment  variables  to  be  more 
important  than  treatment  variables  in  explaining  outcome  variance,  while  Cronkite  and  Moos 
( 1 980)  found  posttreatment  factors  to  be  more  important  than  pretreatment  variables  in 
explaining  variants  in  the  outcome  variables. 

1 0  Client  characteristics  play  a  significant  role  in  terms  of  the  clients'  differential  abilities  to 
make  use  of  social  support.  The  author's  clinical  experience  has  found  that  It  was  a  very  difficult 
task  for  clients  with  schizoid  or  avoidant  personality  disorders  to  effect  a  successful  transition 
into  support  groups. 


Duffer  between  the  alcoholic  client  and  sources  of  stress  (Cobb,  1976; 
Billings  and  Moos,  1981;  Blegel  andYamatanl,  1987). 

Several  studies  have  reported  on  the  apparent  relationship  between 
alcoholic  subjects  having  access  to  family  members  and  subsequent 
outcome  (Costello,  1975;  Tomsovlc,  1980;  Neubuerger  et  al.,  1982). 
Supportive  environments  mediate  stress  and  help  to  reduce  recidivism 
through  the  adoption  of  alternative  problem  solving  strategies.  Bromet  and 
Moos  (1977)  suggest  that  alcoholics  In  stable  marital  and/or  work 
situations  have  a  more  favorable  adjustment  (p.  326).  Regular  AA 
attendance  has  been  associated  with  an  absence  of  life  problems  (Taylor, 
Helzer,  and  Robins,  1 986). 1 1 

In  1977,  Gibbs  and  Flanagan  published  the  results  of  their  search  for 
general  prognostic  indicators  which  would  be  stable  across  studies  and 
consistently  predict  positive  outcomes.12  Their  work  has  become  a 
reference  point,  allowing  more  recent  studies  to  assess  the  relative  clarity 
of  the  contribution  of  their  respective  predictor  variables  to  an 
understanding  of  their  association  with  the  outcome  variables.  Part  of  their 
hypothesis  was  that  strong  or  robust  predictor  variables  could  be  Identified 
from  a  review  of  the  frequency  of  the  predictor  variable's  use  in  the 
literature. 

11  In  general  it  should  be  noted  that  most  studies  which  look  at  the  relationship  between  AA  and 
outcome  variables,  do  not  find  an  association  between  AA  and  behavioral  outcomes,  with  the 
exception  of  remaining  abstinent  from  alcohol. 

' 2  Currently,  much  of  the  treatment  outcome  research  is  directed  towards  locating  specific 
characteristics  of  clients,  treatment  settings,  or  background  environmental  Influences  which  can 
be  used  to  predict  outcome.  This  increased  Interest  in  the  search  for  prognostic  indicators 
originates  In  a  concern  for  cost-etfectlveness  and  cost-control  of  treatment  expenses. 


1. 

9  of  times  CD  Tx 

not  reported 

2. 

AA  attendance 

2 

0 

4 

6 

0.33 

3. 

aftercare 

not  reported 

4. 

age 

16 

1 

18 

35 

0.49 

5. 

education 

6 

1 

13 

20 

0.35 

6. 

employability 

4 

0 

2 

6 

0.67 

7. 

ethnicity 

5 

1 

5 

11 

0.61 

8. 

marital  status 

12 

0 

0 

12 

1.00 

9. 

sex 

5 

1 

7 

13 

0.46 

10. 

type  of  substance 

not  reported 

( *  Total  number  of  treatment  groups  attempting  the  use  of  a  specified  predictor). 


Gibbs  and  Flanagan  (1977)  looked  at  208  predictor  variables  used  in 
45  studies  involving  55  treatment  groups.  None  of  the  variables  met  the 
researchers'  criteria  of  producing  significant  results  in  a  minimum  of  six 
studies.  What  they  found  was  that  in  some  studies  the  specific  variables 
demonstrated  predictive  power  In  one  direction,  while  in  other  studies  the 
same  predictor  variable  would  demonstrate  predictive  power  in  precisely 
the  opposite  direction,  or  there  would  be  no  predictive  relationship  evident. 
This  pattern  of  inconclusive  performance  was  repeated  for  all  of  the 
predictor  variables. 

Table  1  compares  Gibbs  and  Flanagan’s  typology  with  the  eight  control 
variables  and  two  test  variables  identified  in  this  study  as  predictor 


1 3  The  format  for  the  presentation  of  variables  was  adapted  from  the  format  used  in  Kruzich 
( 1 980).  The  idea  regarding  the  creation  of  an  index  of  robustness  belongs  to  the  author ,  as  an 
obvious  extension  of  Gibbs  and  Flanagan’s  ( 1 977)  work. 
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variables.  Using  Gibbs  and  Flanagan's  typology  It  is  possible  to  comment  on 
theYobustness"  of  the  variables,  l.e.  the  ability  to  act  as  a  predictor 
variable  by  looking  at  the  number  of  treatment  groups  in  which  the  variables 
demonstrated  predictive  utility,  when  compared  with  the  total  number  of 
treatment  groups  In  which  the  use  of  the  variable  was  attempted. 

Neubuerger,  Miller,  Schmitz,  Matarazzo,  Pratt,  and  Hasha  (1982) 
suggested  that  the  absence  of  a  consensus  among  predictors  may  be  related 
to  definitional  Issues  in  a  number  of  constructs  associated  with  the 
criterion  measures  of  whafconstltuted  successful  treatment"  (p  960) 
Heckler  (1983),  on  the  other  hand,  attributed  the  absence  of  consistent 
findings  to  the  effect  of  aggregating  treatment  variables.  For  example, 
collapsing  nominal  or  ordinal  variable  categories  to  accommodate  data 
analysis  designs  may  hide  meaningful  relationships  between  the  predictor 
and  criterion  variables.  A  third  possible  explanation  may  relate  to  the  use 
of  large  heterogeneous  samples.  Heckler,  again  notes  that  such  designs  may 
obscure  individual  differences  among  specific  subgroups  (p.  1 15). 

Time  appears  to  be  a  relevant  variable.  The  shorter  the  time  period, 
the  stronger  the  association  between  the  predictive  variable  and  the 
criterion  variable.  Unfortunately  the  reverse  also  holds  true.  Ritson 
(1969),  In  one  of  the  first  outcome  studies  which  looked  at  the  effects  of 
aftercare,  noted  that  the  frequency  of  outpatient  attendance  was  closely 
associated  with  abstinence  at  six  months  and  12  months  post- 
hospitalization.  As  the  period  of  evaluation  is  extended  however,  the  "rates 
of  improvement  tend  to  be  lower"  (Emrick  and  Hansen,  1983,  p.  1081 ). 14 


1 4  This  finding  is  not  too  surprising  In  light  of  the  fact  that  most  aftercare  programs  are,  by 
definition  time  limited.  See  further  discussion  of  this  issue. 


Kruzich  0980)  observed  that  as  the  post-treatment  time  Interval  Increased, 
"program  predictors  demonstrated  a  gradual  deterioration  In  predictive 
powers"  (p.  2)  and  were  replaced  by  client  characteristics  which  became 
more  important  predictors  of  outcome.15 

A  summary  comment  regarding  the  treatment  outcome  literature 
would  be  to  suggest  that  there  are  no  absolutes  in  terms  of  response  to 
treatment.  In  general,  treatment  is  effective  for  some  clients.  Some 
clients  are  able  to  utilize  aftercare  and  AA  services,  and  there  is  a 
relationship  between  utilization  of  these  services  and  remaining  abstinent 
from  the  use  of  alcohol.  In  terms  of  the  literature  reviewed,  there  was  not 
a  consistently  significant  relationship15  empirically  demonstrated  between 
outcome  and  aftercare  or  AA  participation  because  an  almost  equal  number 
of  people  achieved  successful  outcome  measures  with,  or  without,  aftercare 
or  AA.  Kolb,  Cohen,  and  Heckman  ( 1981 )  also  noted  that  many  "unsuccessful” 
problem  drinkers  continued  "to  struggle  with  sobriety  and  look  to  AA  for 
help"  (p.  204). 


15  In  an  earlier  stud/.  Adamson  et  al  ( 1 974)  made  the  same  observations  and  concluded  that 
"the  outcome  of  alcoholism  depends  very  little  upon  the  type  of  treatment,  but  very  much  upon  the 
personal  and  environmental  factors  pertaining  to  the  Individual  patient  treated"  (p.  325). 

15  It  Is  Interesting  to  note  that,  In  addition  to  equivocal  data,  there  are  also  equivocal 
Interpretations  regarding  the  significance  of  the  aggregate  findings  across  studies.  As  an  example, 
Bowen  ( 1 987),  states  conclusively  that  "available  data  supports  the  traditional  view  of  the 
importance  of  aftercare  services  in  alcoholism  treatment"  ( p.  267).  The  author’s  conclusion 
would  be  somewhat  different,  assuming  he  has  had  access  to  the  same  studies  reviewed  by  Bowen. 
This  appears  to  be  one  example  of  ideological  orientation  predominating  over  the  data,  in  which  the 
conclusions  have  been  bent  to  fit  the  model. 


What  happens  to  clients  once  they  complete  treatment?  Most 
treatment  programs  stress  the  necessity  for  clients  to  participate  In  some 
form  of  follow-up  services.17  The  majority  of  treatment  outcome  research 
has  focused  on  client  variables  and  treatment  program  variables.18-19  "A 
significant  gap  In  our  understanding  of  alcoholism  begins  at  the  point  at 
which  treatment  ends"  (Billings  and  Moos,  1983,  p.  205).  Do  clients,  in  fact, 
actually  attend  the  follow-up  services  to  which  they  have  been  referred? 
Can  it  be  demonstrated  that  attending  these  services  determines,  to  any 
meaningful  degree,  the  clients'  posttreatment  functioning?  The  next  two 
sections  of  this  chapter  will  review  the  literature  related  to  aftercare  and 
Alcoholics  Anonymous  programs,  two  types  of  follow-up  services  available 
to  alcoholic  clients. 

Aftercare,  as  a  generic  term,  would  seem  to  connote  a  wide  variety  of 
potential  services  available  to  clients  discharged  from  treatment  centers, 
in  terms  of  the  literature  reviewed  for  this  study,  the  construct  has  much 
more  limited  usage.  In  the  majority  of  the  articles  reviewed,  aftercare 
referred  to  formal,  and  for  the  most  part  time-limited,  group-centered 


1 7  As  will  be  discussed  In  more  detail  In  the  methodological  section  of  this  stud/,  the  author 
conducted  interviews  of  aftercare  coordinators  selected  from  a  list  of  the  33  treatment  programs 
whose  clients  were  followed-up  by  CATOR.  In  every  instance  the  coordinators  reported  a  policy  of 
specifically  encouraging  clients  to  continue  attending  follow-up  supportive  services. 

18  It  is  interesting  to  note  that  the  relatively  few  studies  which  have  looked  at  posttreatment 
functioning  have  found  that  "postreatment  factors  account  for  as  much  or  more  variance  than  does 
patient  background  and  Intake  functioning”  (Cronkite  and  Moos,  1 980,  p.  3 13). 

1 9  EmrickC  1 975),  quoted  In  Kruzlch  ( 1 980)  observed  that  the  "benefit  of  treatment  could  not 
be  demonstrated  when  follow-up  Intervals  extending  beyond  six  months  were  utilized”  ( p.  19). 
This  observation  would  suggest  that  long  term  functioning  will  be  determined  more  by 
posttreatment  variables  than  by  looking  for  the  diminishing  effects  of  treatment  over  time. 


programs  offered  by  treatment  centers  to  help  with  their  clients' 
reintegration  Into  the  community  in  which  the  treatment  center  is  located 
(Chvapll,  Hymes,  and  Delmastro,  1978;  Vannicelll,  1978;  Galanter,  1984; 
Powell,  Penlck,  Read,  and  Ludwig,  1985)20 

In  one  of  the  first  studies  to  look  at  aftercare,  Dubourg  (1969) 
reported  on  a  small  (N  =  76)  sample  of  alcoholics  who  had  been  followed 
from  one  to  two  and  one-half  years.  He  found  that  most  clients  rejected 
outpatient  care.  The  majority  of  clients  who  were  able  to  maintain 
adequate  postreatment  functioning,  did  so  without  recourse  to  aftercare. 

The  clients  who  made  the  most  use  of  aftercare  tended  to  have  the  worst 
outcome.21  Ten  years  later,  in  direct  contrast  to  Dubourg’s  conclusions, 
Costello  ( 1 98u>  found  that  aftercare  contacts  in  the  first  year  “Improved 
the  adjustments  at  follow-up  and  also  Influenced  further  aftercare  contacts 
In  the  second  year”  (p.  53) 22 

Aftercare  has  been  demonstrated  to  consistently  correlate  with 
abstinence  as  the  outcome  measure.  In  an  early  study  of  aftercare,  Ritson 
(1969)  found  that  the  frequency  of  outpatient  attendance  was  closely 
associated  with  abstinence.  In  a  more  recent  study,  Ahles,  Schlundt,  Prue, 


20  In  contrast  Kirk  and  Masi  ( 1 978)  looked  at  aftercare  programs  offered  by  community 
mental  health  centers.  Only  Dubourg  ( 1 969)  looked  at  aftercare  in  terms  of  a  wide  variety  of 
aftercare  programs. 

2 1  Ironically,  Dubourg  ( 1 969)  quoted  the  Alcoholism  subcommittee  of  the  World  Health 
Organization,  which  at  that  time  was  recommending  "energetic  aftercare  to  prevent  relapse,"  as 
the  justification  for  conducting  his  study  (p.  1 55). 

22  mere  are  two  explanations  Immediately  evident  to  account  for  the  differences  in  findings 
between  Dubourg  ( 1 969)  and  Costello  ( 1 980).  The  first  explanation  would  suggest  that  aftercare 
programs  have  matured  and  become  more  effective,  just  as  the  field  itself  has  developed  in 
response  to  the  availability  of  new  information.  The  second  explanation  would  conjecture  that 
Costello's  methodology  was  certainly  more  sophisticated  than  Dubourg's,  and  hence  it  was  more 
likely  that  Costello’s  design  would  be  more  sensitive  to  looking  In  the  right  places  and  asking  the 
relevant  questions.  In  essence,  Costello  may  have  been  able  to  tease  out  the  relationship  between 
aftercare  and  outcome  which  was  missed  by  Dubourg. 


and  Rychtarik  (1983)  noted  that,  for  the  most  part,  "areas  other  than 
abstinence  fall  to  reach  an  acceptable  level  of  significance"  (p.  57)23 

The  timing  of  the  client’s  attendance  In  an  aftercare  program  appears 
to  be  an  Important  Issue  when  looking  at  the  relationship  between  aftercare 
attendance  and  subsequent  outcome.  Recent  evidence  suggests  that  there 
may  be  a  strong  relationship  between  successful  outcome  and  attendance  in 
aftercare  groups  Immediately  following  discharge  from  an  Inpatient 
treatment  center.  Elal-Lawrence,  Slade,  and  Dewey  ( 1 987)  found  that  most 
relapsers  in  the  first  year  following  discharge  tended  to  procrastinate 
utilizing  aftercare  services,  or  attended  only  sporadically.24 

The  physical  location  of  the  aftercare  program  may  also  be  an 
important  intervening  variable.  Vannlcell!  (1978)  noted  that  aftercare  may 
only  have  an  Impact  when  It  Is  a  direct  extension  of  the  Inpatient  program 
from  which  the  client  was  discharged.2^  citing  their  findings  that  Inpatient 
treatment  can  "be  used  as  a  springboard  for  continuity  of  care  provided  by 
the  same  treatment  program,"  Chvapil  et  al.  (1978)  looked  at  an  outpatient 


23  The  relationship  between  aftercare  aid  abstinence  Is  ambiguous,  as  is  the  relationship 
between  AA  attendance  and  abstinence.  See  further  discussion  in  the  next  section  of  this  chapter. 

24  It  Is  the  author's  opinion  that  Elal-Lawrence,  Slade,  and  Dewey  ( 1 987)  may  be  confounding 
variables  in  terms  of  suggesting  that  procrastination  in  the  use  of  a  service  and  sporadic  use  are 
somehow  related  and  reflective  of  the  same  dynamic.  The  author  would  suggest  that  the  dynamics 
may  be  very  different.  Like  sporadic  AA  attendance,  there  are  a  number  of  possible  explanations 
for  sporadic  aftercare  attendance.  The  most  Intuitive  explanation  for  sporadic  attendance  would  be 
to  conclude  that  It  Is  reflective  of  a  measure  of  ( lower)  motivation  rather  than  a  direct  measure  of 
the  Identified  variable.  Second,  sporadic  attendance  has  been  associated  with  asking  for  help, 
which  tends  to  occur  when  there  are  recurrences  of  active  problems  which,  in  turn,  could  tend  to 
lead  to  a  more  negative  outcome, 

25  Galanter  ( 1 984)  concurred  with  this  observation.  He  found  that  providing  outpatient 
treatment  within  a  treatment  program  enhances  a  "program- wide  mutual  affiliation,"  as  the 
outpatient  members  see  themselves  as  part  of  the  larger  group.  His  findings  are  subject  to  many 
of  the  same  confounding  effects  reported  in  other  studies.  For  example,  he  chose  a  self-help  group 
format  for  his  control  group.  As  the  effect  of  self-help  groups  (AA)  is  clearly  confounded  with 
both  the  effect  of  treatment  and  the  effect  of  aftercare,  his  results  must  be  approached 
conservatively. 


program  operated  Dy  a  treatment  facility  which  accepted  direct  outpatient 
referrals  from  the  community, in  addition  to  providing  follow-up  services 
for  their  own  Inpatient  clients.  The  clients  who  did  not  go  through  the 
inpatient  program  did  not  do  as  well  as  clients  who  had  first  been  treated 
on  an  inpatient  basis  before  receiving  follow-up  services.(p.  543) 26 

Aftercare,  as  a  predictor  variable,  has  been  found  In  several  studies 
to  have  been  unrelated  to  outcome,  usually  defined  as  remaining  sober  over 
time.  Controlling  for  the  duration  of  alcoholism,  Kirk  and  Masl  (1978)  found 
that  receiving  aftercare  services  did  not  influence  readmission  rates. 
Intensity  of  aftercare  services  was  not  significantly  related  to  outcome  at 
a  one-year  follow-up  point  (Powell  et  al,  1985).  The  "outpatient  treatment 
modality"  of  aftercare  offered  by  a  treatment  program  was  also  not 
associated  with  outcome  (Powell  et  al,  1985,  p.  312).  From  a  different 
direction  Omsteln  and  Cherepon  (1985)  looked  at  aftercare  participation  as 
a  criterion  variable.  They  were  not  able  to  find  any  significant  predictor 
variables  which  would  predict  aftercare  participation.  Looking  at  the  type 
of  aftercare  services  offered,  Gilbert  (1988)  did  not  find  any  correlation 
between  the  types  of  aftercare  and  a  variety  of  outcome  measures.27 

One  issue  which  has  received  a  little  attention  relates  to  the  time- 
limited  factor  of  aftercare.  How  much  Is  enough?  One  estimate  of  the 
range  of  aftercare  services  can  be  found  in  Kirk  and  hast  (1978).  They 

26  There  was  significant  confounding  of  the  variables  in  this  stud/-  It  was  not  established  in 
Chvapil  et  al.  ( 1 978),  that  the  direct  outpatient  referral  group  ( receiving  services  for  the  first 
time)  was  identical  on  all  variables  with  the  exception  of  mode  of  referral  to  the  inpatient  group 
receiving  aftercare  services.  Clearly  length  of  treatment,  severity  of  problem ,  types  of  treatment 
are  relevant  variables  which  would  need  to  be  accounted  for  prior  to  reaching  their  conclusion 
regarding  the  efficacy  of  continuity  of  service  and  the  importance  of  aftercare. 

27  In  a  literature  review  which  accompanied  his  study,  Gilbert  ( 1 988)  found  that  minimal 
aftercare  was  "no  more  effective  than  no  aftercare  whatsoever"  (p.  1 56). 
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reported  a  range  of  visits  from  one  to  1 50+  visits  with  the  median  being 
less  than  six  visits.28  >29  vannlcellt  (1978)  observed  that  clients  who  were 
doing  the  best  tended  to  drop  out  of  aftercare  after  a  short  period  of 
Involvement,  usually  between  three  and  six  months.  The  question  quickly 
becomes  one  of  asking  what  Is  a  reasonable  expectation  from  such  a 
relatively  short  period  of  Involvement?  For  how  long  a  period  of  time  would 
it  be  expected  that  the  effect  of  aftercare  could  be  sustained  or  measured? 

Given  the  absence  of  a  consistent  relationship  between  aftercare  and 
outcome,  one  can  begin  to  question  whether  aftercare  should  be  considered 
an  independent  variable.30  None  of  the  studies  reviewed  looked  at  aftercare 
independently  from  AA  attendance.  Intuitively  one  might  predict  an 
interaction  between  aftercare  and  AA  attendance,  just  as  there  may  well  be 
an  interaction  between  AA  attendance  and  Inpatient  treatment  effects.31 

While  it  Is  clear  from  the  literature  that  aftercare  is  Ideologically 
conceptualized  by  treatment  programs  as  an  Important  service,  the  data 
does  not  provide  a  strong  confirmation  of  this  view  of  aftercare.32  This  may 


28  Osslp-Kleln  ( 1 984)  reports  a  50$  dropout  rate  after  the  first  scheduled  visit  ( p.  85). 

29  in  an  earlier  study,  Porkorny  ( 1 973)  found  that  only  38$  of  his  sample  were  able  to  attend 
between  one  and  three  aftercare  sessions.  34$  never  attended  and  another  28$  attended  only 
occasionally  (as  reported  in  Pratt,  Linn,  Carmichael,  and  Webb,  1977,  p.  915). 

30  The  data  from  a  variety  of  studies  is  equivocal.  "Some  studies  find  significant  effects  of 
aftercare  while  others  have  found  no  difference  in  outcome  between  aftercare  participants  and 
nonparticipants"  (Finney,  Moos,  and  Mewborn,  1980,  p.  18) 

31  As  a  conjectural  aside,  from  this  perspective  a  case  could  be  made  that  aftercare  does  not 
operate  independently  from  treatment  effects  but  simply  represents  an  extension  of  the  inpatient 
treatment  effect.  Aftercare's  perceived  function  as  an  Independent  variable  could  be  attributed  to 
the  extension  of  Inpatient  treatment  effects  being  confounded  with  AA  attendance.  Certainly 
Galanter's  observation  of  the  importance  of  the  "mutual  affiliation  and  cohesiveness”  generated  by 
physically  locating  the  outpatient  program  within  the  inpatient  unit  speaks  to  this  issue  ( 1 984) 

32  Finney  et  al.  ( 1 980)  concluded  that  "preventive  aftercare,  defined  as  outpatient  therapy  and 
AA,  showed  few  significant  relationships  with  outcome  measures"  ( p.  26).  The  authors 
appropriately  note  that  the  absence  of  an  observed  relationship  may  have  more  to  do  with  the  lack 
of  sensitivity  of  their  measurement  than  factors  inherent  in  either  the  variables  or  the  lack  c*  a 
relationship  between  them. 
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be  a  particularly  relevant  observation  in  terms  of  the  apparent  absence  of 
research  regarding  free-standing  aftercare  programs  operating 
independently  or  separately  from  the  Inpatient  treatment  facilities. 


The  history  of  alcoholism  treatment  has  been  well  documented 
elsewhere  (Kurtz,  1979;  Rorabaugh,  1979  Aaron  and  Musto,  1981 ;  Kinney  and 
Leaton,  1983;  Mendelson  and  Mello,  1 985;  and  Ames,  1985).  With  the 
exception  of  a  relatively  short  period  of  time  In  the  19th  century  (the  early 
1840s)  when  our  society  was  more  favorably  predisposed  towards  the 
treatment  of  alcoholics,  our  societal  response  to  persons  with  alcohol 
problems  has  not  been  very  humane.33  Saxe  ( 1 983)  notes  that  until  the 
1 950‘s,  the  "treatment  for  alcoholism  was  more  likely  to  have  been 
Incarceration  or  custodial  care  than  to  have  been  medical  or  psychological 
therapy"  (p.  35). 

This  historical  digression  Is  necessary  to  establish  the  importance  of 
looking  at  Alcoholics  Anonymous  as  a  support  service  for  alcoholics.  Since 
its  founding  in  1935,  AA  has  been  a  dominant  factor  in  the  provision  of 
treatment  and  support  services  to  alcoholics.  Many  alcoholics  have 
successfully  come  to  terms  with  their  alcohol  problems  using  AA  and  no 
other  services  (Valllant,  1981;  Bowen,  1987).  Of  equal,  If  not  more 
Importance  has  been  AA's  contribution  to  our  theory  of  alcoholism  and 
alcohol  treatment  through  Its  Informal  but  persistent  espousal  of  the 
"disease  of  alcoholism"  by  Its  membership.34 

33  For  a  good  discussion  of  societal  attitudes  towards  common  drunkards,  1 800-  1 850,  see 
Lull  ( 1 986).  During  the  relatively  short  period  of  the  Washingtonian  movement  ( 1 840-  1 850), 
many  of  the  precursors  to  modern  treatment  were  Introduced,  including  such  concepts  8S  self-help 
groups,  the  necessity  for  social  detox  of  inebriates,  individualized  treatment  plans, and  a  d/namic 
cyclical  treatment  mode)  (as  opposed  to  a  linear  and  static  model). 

34  Kenney  and  Leaton  ( 1 983)  properly  note  that  AA  has  no  official  definition  of  alcoholism. 
Based  primarily  on  the  work  of  Jellinek  ( 1 960),  many  health  organizations  have  found  it 


According  to  AA's  most  recent  triennial  survey,  the  U.S.  AA 
membership  exceeds  630,000  (AA  World  Services,  1984).  Compared  with 
the  estimated  18  million  persons  with  alcohol  problems,35  the  AA 
membership  Is  In  a  clear  minority  36  Bean  (1975)  reported  that  AA  claims  a 
"success  rate  of  75%;  50%  on  the  first  approach  to  AA,  and  half  the  first¬ 
time  failures  on  their  later  return  to  try  again"  (p.  1 1/20) 37-38  Regular  AA 
attendance  was  found  to  be  almost  effective  as  formal  inpatient  treatment 
In  a  chemical  dependency  program  (Clare,  1 976,  p.  282) 

Despite  considerable  testimonial  support  for  AA,  there  are  only  a 
small  number  of  studies  which  look  at  AA  participation  as  the  primary  focus 
of  the  study.  (Bebblngton,  1976;  Henry  and  Robinson,  1978;  and  Hoffmann, 
Harrison,  and  Bell  lie,  1983).  A  somewhat  larger  group  of  studies  looked  at 
AA  Involvement  as  being  one  component  in  a  multiple  regression  analysis 
(Kruzlch,  1980;  Gordls,  Dorph,  Sepe,  and  Smith,  1981;  Kolb,  Cohen,  and 
Heckman,  1981;  Pettlnatl  et  al.  ,1982;  Taylor,  Helzer,  and  Robins,  1986;  and 
Elal-Lawrence  et  al.,  1987). 

AA  presents  researchers  with  several  methodological  hurdles.  As  an 
organization  committed  to  anonymity,  It  Is  difficult  to  engage  its 
membership  in  any  type  of  research  design.  Second,  its  membership  criteria 
are  so  loosely  defined  that  It  Is  difficult  to  structurally  define  group 

expedient  to  define  alcoholism  as  a  disease,  Illness  or  syndrome  (Vail  lant,  1 983).  The  informal 
acceptance  of  the  disease  concept  of  alcohol  Ism  by  AA  membership  predates  Jellinek’s  work.  For 
an  insightful  discussion  of  the  development  of  this  thinking  see  kurt2  ( 1 979),  pp.  99-  1 29. 

35  Williams  (in  press)  as  quoted  by  Bowen  (1987), 

36  "0nlyabout5$-  1 0%  of  the  alcoholics  in  this  country  use  AA "( Bean,  1975,  p.  11/20). 

37  In  contrast,  based  on  the  results  of  a  number  of  empirical  studies,  Hiller  and  Hester 
( 1 980)  estimated  that  AA's  absttnence  rate  was  between  26$  and  50$. 

38  Mendelson  and  Hello  ( 1 985)  suggest  that  we  do  not  "possess  the  scientific  data  to  either 
support  or  refute  the  relative  efficacy  of  AA  for  the  treatment  of  alcoholism"  ( p.  340). 


membership.  Bebblngton  (1976)  concluded  that  the  “totality  of  studies 
regarding  AA  does  not  add  significantly  to  the  knowledge  concerning  AA“ 

(p.  572).  The  third  problem  regarding  AA  membership  relates  to  the  issue 
of  self-selection.  By  defining  oneself  as  a  member  of  AA,  the  client  already 
has  some  awareness  of  an  alcohol  problem  and  has  some  degree  of 
willingness  to  correct  the  problem.  Bebblngton  noted  that  the  issue  quickly 
becomes  one  of  attempting  to  separate  treatment  efficacy  from  preexisting 
motivation.  Obviously  In  a  correlational  design  this  task  is  formidable  if 
not  impossible. 

A  number  of  studies  commented  on  possible  theoretical  explanations 
for  the  claims  of  a  significant  "treatment  effect"  attributed  to  AA  (Bean, 
1975;  Zlnberg,  1977;  Beckman,  1980;  and  Kurtz,  1985).  Beckman  (1980) 
described  the  effect  of  the  group  s  influence  on  clients  and  suggested  that 
AA  stimulates  "cognitive  change  which  facilitates  behavioral  change" 

(p.  717).  Kurtz  (1985)  felt  that  AA's  program  directly  alters  the 
Individual’s  "narcissistic  ,  grandiose  perceptions  and  assists  in  the 
development  of  a  more  mature  self-concept"  (p.  1 1 1 ).  Bean  (1980) 
concluded  that  AA  Introduces  learning  theory,  resulting  In  the  extinction  of 
drinking  while  systematically  reinforcing  sobriety. 

Other  studies  view  AA’s  contribution  from  the  perspective  of  a  self- 
help  group  facilitating  alcoholics'  desires  to  remain  abstinent  from  further 
drinking  (  Leach,  1973;  Bebblngton,  1976;  Robinson  ,  1979;  and  Donovan, 
1984)  Maintaining  sobriety  Involves  more  than  merely  attending  an  AA 
meeting  (Henry  and  Robinson,  1 978).  Bebblngton  ( 1 976)  notes  that  AA 
attendance  involves  a  "complex  process  of  affiliation  of  which  only  a  part  is 
related  to  Influences  effecting  a  progression  from  inebriety  to  sobriety” 
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(p.  579).  This  network  of  informal  relationships  extend  beyond  the  formal 
AA  meeting  (Henry  and  Robinson,  1 978). 39 

A  consistent  finding  across  the  relatively  few  studies  which  have 
attempted  to  empirically  look  at  AA  Involvement  Is  that,  while  there  Is  a 
moderate  correlation  between  AA  attendance  and  abstaining  from  the  use  of 
alcohol,  the  data  suggests  that  AA  Is  not  for  everyone.  Hoffmann,  Harrison, 
and  Belllle  (1983)  found  that  clients  either  attend  weekly  (48%),  or  they  do 
not  attend  at  all  (38%).40  Likewise,  Pettlnatl  et  al.  (1982)  found  that  only 
25%  of  their  subjects  were  regular  attenders,  whereas  Elal-Lawrence  et  al. 

( 1 987)  reported  that  33%  of  their  subjects  were  regular  attenders.  Given 
the  ideological  emphasis  treatment  centers  tend  to  place  on  AA 
involvement,  one  might  expect  a  larger  percentage  of  clients  to  have  become 
involved.41 

As  discussed  above,  there  are  definite  limitations  to  correlation^ 
designs.  One  concrete  example  of  the  effect  of  this  limitation  is  the 
difficulty  in  interpreting  the  moderate  correlation  between  AA  attendance 
and  abstinence  which  Is  consistently  reported  In  the  literature.  The  central 
question  Is  whether  AA  keeps  people  sober  or  whether  "sober"  clients  are 
attracted  to  AA  and  consequently  would  do  well  in  any  case  (Gordls  et 
al.,  1 986,  p.  520).  Tournler  ( 1 979)  suggested  that  the  high  success  rate 

39  Gellman  ( 1 964),  quoted  in  Robinson  ( 1 979)  sees  the  "most  important  aspect  of  AA  as  being 
the  socialization  process  which  leads  to  experiencing  AA  as  a  way  of  life”  ( p.  35). 

40  Only  a  relatively  small  number  of  clients  attend  AA  on  an  occasional  or  sporadic  basis 

( Hoffmann  et  al. ,  1 983).  Both  occasional  aftercare  attendance  and  occasional  AA  attendance  have 
been  associated  with  a  less  successful  outcome  (Pettinati  et  al. ,  1 982;  and  Elal-Lawrence  et  al. , 
1987). 

41  Which  Is,  in  a  sense  further  confirmation  that  AA  is  not  for  everyone.  Zinberg  ( 1 977) 
concluded  that  despite  AA's  "relative  success  with  hard-core  alcoholics,  it  does  not  show  great 
promise  for  the  prevention  of  alcoholism ,  and  it  hardly  offers  a  model  for  the  controlled  use  of 
intoxicants"  ( p.  101). 


attributed  to  AA  is  the  result  of  clients,  whose  sobriety  is  already  well 
established,  being  attracted  to  AA  rather  than  any  quality  tnherent  in  AA  or 
related  to  a  treatment  effect  associated  with  AA.42 

Attempts  have  been  made  to  further  explore  the  relationship  between 
AA  attendance  and  the  outcome  variable,  which  Is  usually  abstinence.  For 
example,  Kolb,  Cohen,  and  Heckman  ( i 98 1 ),  controlling  for  subjects’  ages, 
found  a  significant  relationship  between  alcohol  consumption  and  AA 
attendance.  In  general,  as  the  effects  of  other  variables  were  controlled 
for,  the  significance  of  the  observed  relationship  between  AA  attendance 
and  abstinence  decreased  markedly.  Most  of  the  studies  which  found 
significant  associations  between  aftercare  or  AA  attendance  and  outcome 
tended  not  to  control  for  background  characteristics  (Finney  et  al.  1980).43 

A  final  problem  regarding  the  empirical  study  of  AA  involvement 
relates  to  issues  of  conflicting  ideology.44  In  the  chemical  dependency 
treatment  field,  Ideological  lines  tend  to  be  rigidly  drawn  with  little 
dialogue  across  the  lines.45  The  Integral  Issue  Is  a  difference  in  the 


42  It  is  the  author’s  opinion  that,  in  part,  the  intensity  of  the  discussion  regarding  the  efficacy 
of  AA  is  the  direct  result  of  "fuzzy  conceptualization."  A  number  of  researchers  have  looked  at  AA 
as  providing  a  "treatment  effect"  Other  researchers  conceptualize  AA  as  a  supportive  service  to 
maintain  the  treatment  effect  In  the  latter  case  the  "treatment  effect"  can  be  considered  as  being 
the  result  of  either  external  influences  ( i.e.  Inpatient  treatment  programs)  or  internal  influences 
( i.e.  motivation). 

43  A  more  conservative,  perhaps  ominous  conclusion  is  that  "the  more  carefully  the  patients 
are  scrutinized  and  the  more  rigorous  the  analysis,  the  worse  is  the  outcome"  (Gordis  et  al. , 

1981,  p.  521). 

44  While  recognizing  the  importance  and  contribution  of  AA,  Tournier  ( 1 979)  felt  strongly 
that  the  resulting  belief  system  contributed  to  "the  rejection  of  innovative  strategies...  and  the 
depreciation  of  possible  discovery  and  Implementation  of  alternative  approaches"  ( p.  237). 

45  A  personal  conclusion  based  on  1 4  years  of  observations  is  to  note  the  absence  of  any  sense  of 
sustained  dialogue  between  mental  health  professionals  and  alcoholism  counselors,  the  former 
tending  to  be  theory  based  while  the  latter  tend  to  be  experlentlally  based.  "Many  recovered 
alcoholics  tend  to  be  ferociously  intolerant  of  any  treatment  approach  different  from  what  was 
helpful  to  them,  and  rhetoric  and  an  evangelical  zeal  often  supersede  dispassionate  evaluation  of 
treatment  outcome"  (Mendelson  and  hello,  1985,  p.  319). 


approach  to  coming  to  terms  with  life  issues  and  a  sense  about  how  reality 
ought  to  be  perceived.  The  researcher  is  grounded  in  the  scientific  method 
whereas  the  “seif-help  group  member  is  grounded  in  dogma  and  faith" 

(Moore,  1979,  p.  330).  The  self-help  group  member  deals  with  conflict  by 
resorting  to  a  position  of  "don't  bother  me  with  the  facts,  I  know  what 
works  for  me."  Rosenberg  (1979)  attributes  the  ideological  conflict  to  a 
difference  between  "scientific  and  lay  approaches  to  treatment"  (p.  331 ) 

To  a  certain  degree  new  sources  of  information  have  led  to  more 
sophisticated  models  which,  in  turn,  have  tended  to  make  the  ideological 
debate  increasingly  obsolete.  Over  the  years  improvements  in  the 
treatment  process  have  tended  to  occur  incrementally.  The  appreciation  of 
family  systems,  multldetermined  syndromes,  relapse  prevention,  are 
examples  of  new  concepts  and  techniques  which  have  found  their  way  into 
the  alcoholism  treatment  field.  These  new  techniques  and  concepts  have 
tended  to  make  the  model  of  alcoholism  as  a  unitary  disease  with  its  "all- 
or-none"  solution  irrelevant.46  Clients,  professionals  and  paraprofessional 
alcoholism  counselors  are  benefiting  from  this  increased  knowledge. 
Consequently  one  might  well  expect  a  mellowing  of  the  dialogue  over  the 
next  few  years.47 

The  "Rand  Report"  published  in  1976,  created  an  uproar  when  it 
concluded  that  controlled  drinking  might  be  a  realistic  alternative,  (Armor, 
Polich,  and  Stambul).  Shortly  thereafter,  Sobell  and  Sobell  (1978)  stirred  up 
the  waters  another  time  with  their  study  proposing  to  teach  alcoholics  to 

46  A  paraphrase  of  a  conversation  with  Dr.  Norman  G.  Hoffmann  regarding  the  significance  of 
developments  and  changes  within  the  alcoholism  treatment  field. 

47  Kurtz  ( 1 985)  sees  this  development  as  leading  to  (increased)  "cooperation  between 
professionals  and  AA  members  involving  (more)  frequent  interaction,  ( increasingly)  congruent 
ideas  about  treatment  and  (the  development  of)  appropriate  linking  strategies"  (p.  1 1 0). 
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become  successful  social  drinkers.  A  third  ideological  explosion  occurred  in 
1979  when  Tournler  suggested  that  AA's  beliefs  could  possibly  negatively 
influence  recovery  for  clients  who  did  not  accept  all  of  their 
propositions.48  The  repercussion  of  all  of  the  above  has  been  to  create  a 
fairly  unstable  ideological  setting  within  which  the  researcher  has  had  to 
contend  with  significant  methodological  limitations.  This  conf llctual 
atmosphere  has  been  offered  as  one  of  the  reasons  alcoholism  research  has 
not  progressed  further  (Klncannon,  1 987).  As  we  move  further  away  from 
the  strident  confrontations  of  the  late  1970s  and  early  1980s,  one  might 
expect  enhanced  cooperation  to  result  In  a  qualitative,  if  not  quantitative 
improvement  In  the  alcoholism  research  literature. 
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48  Commenting  on  Tournier’s  observations,  Demone  ( 1 979)  placed  the  Issue  in  perspective 
noting  that  It  was  not  realistic  to  expect  an  "Ideologically  based  organization  to  comfortably  accept 
opposing  explanations"  (p.  335). 
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This  section  of  the  literature  review  summarizes  findings  from 
studies  which  looked  at  social  support  and  self-help  groups,  in  addition  the 
author  comments  briefly  on  the  need  for  a  general  model  to  synthesize 
findings  from  a  number  of  disparate  research  areas.  The  relative  absence  of 
integration  among  a  variety  of  seemingly  associated  topics  (i.e.,  self-help, 
social  support,  AA,  aftercare,  pretreatment-treatment-posttreatment 
predictors  of  functioning,  etc.)  suggests,  as  a  topic  for  further  study,  the 
development  of  a  systems  model  which  could  achieve  this  integration  and 
enhance  our  understanding  of  alcoholism  intervention. 

Recent  studies  have  demonstrated  that  over  time  alcoholics' 
experiences  with  their  drinking  problems  are  quite  varied  (Bromet  and  Moos, 
1977;  Pettlnati  et  al.,  1982;  Billings  and  Moos,  1983;  andMcCrady  and  Sher, 
1983).  A  static,  problem  ->  treatment  ->  outcome  model  simply  does  not  do 
Justice  to  the  data.  A  more  comprehensive  and  dynamic  model  could  be 
developed  which  would  emphasize  the  importance  of  a  systems 
perspective.49 

Integrating  available  information  from  a  number  of  studies,  a  model 
using  a  systems  perspective  could  be  developed  which  would  emphasize 
environmental  factors  in  addition  to  personal  and  programmatic  factors. 

49  Having  carried  out  a  comprehensive  literature  review,  this  writer  is  not  aware  of  any 
resources  which  fully  explicate  alcoholism  intervention  from  a  systems  perspective.  If  this 
observation  is  accurate,  then  obviously  this  is  an  area  which  should  be  developed.  Moos  and  Finney 
( 1 983)  do  present  a  brief,  "process  oriented  framework  for  evaluation  of  alcoholism  treatment" 
which  schematically  addresses  the  issue.  Billings  and  Moos  ( 1 983)  use  path  analysis  to  clarify 
the  relationships  among  predictor  variables  as  they  effect  the  outcome  variable.  What  is  missing 
is  a  theoretical  model  which  integrates  these  kinds  of  partial  pieces  of  the  picture. 
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For  example,  extratreatment  factors  such  as  "environmental  stressors, 
coping  resources,  and  social  resources  provide  as  much  Information  about 
treatment  outcome  as  patient  characteristics  and  treatment  factors 
combined"  (Billings  and  Moos,  1983,  p.  2 1 3) 50  More  specifically,  "stable 
family  environment  and  work  environments”  have  been  demonstrated  to 
correlate  with  favorable  adjustment  (Bromet  and  Moos,  1977,  p.  326).  in  a 
similar  fashion,  AA  attendance  and  to  a  lesser  degree,  aftercare  attendance 
have  been  shown  to  correlate  with  successful  outcome. 

A  systems  model  could  explicate  the  relationships  among  such  areas 
as  the  development  of  alcohol  problems,  the  effects  of  intervention, 
successful  functioning,  continued  alcohol  problems,  etc.5’  Marlatt  (1985) 
has  suggested  that  there  may  be  a  reciprocal  relationship  between  continued 
drinking  and  other  life  problems.  Continued  drinking  may  create  additional 
levels  of  stress  or  interfere  with  the  resolution  of  other  life  problems. 
Stress  from  other  life  problems  may  encourage  further  drinking.52 

An  Intriguing  hypothesis  advanced  by  Bromet  and  Moos  (1977)  ties 
together  Marlatt's  observations  regarding  life  problems,  stress,  and 
continued  drinking  with  other  aspects  of  the  alcoholic's  larger  social 
system.  An  alcoholic's  family  environment,  work  environment,  AA,  and 


50  As  noted  earlier  In  this  stud/,  even  though  extratreatment  factors  have  demonstrated  an 
association  with  outcome,  the  majority  of  the  variance  in  outcome  remains  to  be  explained. 

5 1  One  consequence  of  a  static  model  in  describing  the  course  of  events  in  an  alcoholic's  life  is 
that  predictor  variables  tend  to  be  viewed  in  terms  of  either  being  present  or  absent.  A  d/namic 
model  would  suggest  that  the  predictor  variables  may  change  in  terms  of  their  relative  importance 
over  a  period  of  time.  kru2lch  ( 1 980)  highlights  the  differential  weighting  of  treatment  effects 
and  personal  characteristics  as  a  function  of  time.  McCrady  and  Sher  ( 1 983)  hypothesize  that  the 
variables  mediating  relapse  may  differ  qualitatively  from  the  variables  which  maintain  problem 
drinking  (p.  338). 

52  The  "persistence  of  other  life  problems  may  be  a  useful  predictor  of  relapse  and  may 
suggest  additional  intervention  strategies"  Miller,  Hedrick,  and  Taylor  (1983,  p.  41 1). 
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aftercare,  share  In  common  the  capacity  to  intervene  as  a  buffer  between 
the  alcoholic  and  other  sources  of  stress  (Including  continued  drinking). 

Through  its  emphasis  on  changing  drinking  behaviors  to  promote 
abstinence,  Moos  and  Finney  (1983)  feel  that  AA  provides  both  a  supportive 
network  and  a  change  In  group  expectations  and  norms  which  can  act  to 
"foster  a  less  stressful  life  style"  (p.  1041).  The  resulting  lifestyle  is 
hypothesized  to  reduce  the  risks  of  returning  to  drinking.  Galanter  ( 1 984) 
has  Identified  these  changes  in  group  expectation  as  a  "resocialization 
effect"  produced  by  the  Interaction  between  "cohesive  ties  of  the 
membership  and  consensual  beliefs"  (p.  22).53 

Rather  than  emphasizing  a  treatment  effect,  per  se,  a  number  of 
studies  have  looked  at  AA  from  Its  function  as  a  self-help  group  providing 
social  support  (Levy,  1978;  Robinson,  1979;  Knight,  WoJlert,  Levy,  Frame, 
and  Padgett,  1980;  Rlordan  and  Beggs,  1987).54  The  significance  of  looking 
at  self-help  groups  in  terms  of  their  role  in  providing  social  support  is,  that 
as  a  construct,  these  functions  of  self-help  groups  can  be  neatly  integrated 
into  a  systems  model  of  recovery. 

In  one  of  the  first  studies  to  look  at  social  support  as  a  moderator  of 
life  stress,  Cobb  (1976)  hypothesized  that  social  support  could  be  defined  In 
terms  of  specific  Information  communicated  from  others  to  the  person 
experiencing  life  stress.55  Specifically  he  defined  social  support  as  the 

53  Continuing  in  the  same  vein,  McCrady  and  Sher  ( 1 983)  suggest  that  the  whole  organization 
of  AA  is  geared  to  "a  reorganization  of  an  alcoholic's  social  network  and  a  reordering  of  the 
alcoholic's  Interpersonal  world"  (p.  338), 

54  One  advantage  of  looking  at  AA  from  this  perspective  is  that  it  is  an  easier  task  to  develop 
constructs  which  reflect  or  measure  social  support,  than  it  is  to  develop  constructs  which 
represent  a  hypothesized  treatment  effect.  The  underlying  issue  is  one  of  the  level  of  abstraction 
required  in  the  basic  assumptions  upon  which  a  model  being  developed. 

55  "Others"  being  defined  as  friends,  family,  neighbors,  members  of  a  self-help  group, 
acquaintances,  colleagues,  health  care  providers,  etc.  Broadly  addressed,  the  definition  of  social 


Information  which  leads  a  subject  to  "believe  he  or  she  is  cared  for,  loved, 
esteemed,  and  Is  accepted  as  a  member  of  a  network  of  mutual  obligations" 
(p.  300).  It  Is  the  “emotional,  afflrmatlonal,  or  Informational  activities  of 
help  giving",  which  are  common  to  all  self-help  groups  (Blegel  and  Vamatani, 
1987,  p.  1197). 

The  importance  of  self-help  groups  can  be  gauged  from  the  fact  that 
there  are  now  approximately  500,000  self-help  groups  In  the  U.S.  with  an 
estimated  combined  membership  of  more  than  15  million  (Rlordan  and 
Beggs,  1987,  p.  427).  Self-help  groups,  as  voluntary  small  group  structures, 
can  be  Influential  In  terms  of  assisting  Individuals  In  their  adaptation  to 
life  situations, and  In  developing  coping  responses  to  life  problems 
(Hermann,  Melendez,  Kamarck,  Kievans,  Ballen,  and  Gordon,  1979;  and  Katz, 
1981,  as  quoted  In  Rlordan  and  Beggs,  1987). 

A  number  of  studies  have  looked  at  social  support  as  a  predictor  of 
subsequent  outcome.  Dlmsdale,  Eckenrode,  Haggerty,  Kaplan,  Cohen  and 
Dornbusch  ( 1 979)  noted  that  there  was  "Increasing  evidence  that  the 
presence  or  absence  of  social  supports  carried  with  it  certain 
epidemiological  risks  and  benefits"  (p.  1 75).  Holahan  and  Moos  (1981)  found 
an  Inverse  relationship  between  social  support  and  a  variety  of  Indices  of 
psychological  distress.56  Dlmsdale  et  a).  (1979)  found  social  support  to  be 

support  could  involve  a  relationship  between  one  or  more  Dersons  and  another  person,  for  the 
purpose  of  providing  some  type  of  assistance  for  the  latter.  A  close  examination  of  social  support 
suggests  that  it  can  be  viewed  form  a  variety  of  perspectives  ranging  from  very  simple  to  very 
complex. 

56  Another  finding,  which  is  remarkably  consistent  among  all  of  the  studies  which  have 
attempted  to  find  measures  of  social  support  which  predict  outcome  functioning  is  that  the 
observed  relationships  tend  to  be  statistically  significant  but  explain  very  little  of  the  variance  in 
the  criterion  variable.  The  magnitude  of  the  associations  is  quite  low  in  an  absolute  sense 
(Holahan  and  Moos,  1981,  p.  369), 


"highly  relevant  to  morbidity  and  mortality"  (p.  1 79).57  The  predictive 
value  of  social  support  was  "less  salient  among  men  than  among  women" 
(Billings  and  Moos,  1981,  p.  154). 

The  recent  research  focusing  on  social  support  and  self-help  groups 
could  be  particularly  relevant  for  Increasing  our  understanding  of  the 
relationship  between  AA,  aftercare  and  recovering  alcoholics'  in  terms  of 
their  functioning  on  a  number  of  outcome  variables.  A  number  of 
instruments  have  been  developed  and  validated  which,  If  used,  could  provide 
information  about  how  AA  and  aftercare  function  in  their  social  support 
roles.  Synthesizing  this  additional  information  with  a  model  using  a 
systems  perspective  could  significantly  advance  our  knowledge  regarding 
Intervention  and  adaptation  to  alcoholism. 


57  A  particularly  intriguing  finding,  and  potentially  quite  controversial,  although  not  having 
been  identified  as  such,  is  Blegel  and  Yamatani's  conclusion  that  families  "requiring  assistance  in 
interacting  with  the  patient  and  learning  specific  skills  for  coping  with  a  chronic  mental  Illness 
are  unlikely  to  receive  such  assistance  through  a  self-help  group"  ( 1 987,  p.  1 1 97)  Certainly 
this  conclusion  contradicts  the  avowed  purpose  statement  of  many  self-help  groups,  such  as 
AlAnon,  AA,  PA  ( Parents  Anonymous),  Tough  Love,  etc. 


As  suggested  above,  there  are  significant  methodological  and  design 
problems  evident  In  the  alcohol  treatment  literature.58  This  section  will 
address  a  number  of  specific  Issues.  Treatment  outcome  studies  are,  for 
the  most  part,  passive  observational  designs.  Over  the  years  a  large  number 
of  correlates  of  outcome  have  been  explored  with  varying  degrees  of 
success.59  A  significant  stumbling  block  for  researchers  has  been  the 
difficulty  In  moving  beyond  correlational  analysis  to  begin  to  search  for 
causal  relationships  between  the  Independent  and  dependent  variables. 

While  clearly  being  the  preferred  approach  In  general  discussions  of 
research  design60,  the  use  of  control  groups  and  randomized  clinical  trials 
In  the  alcoholism  treatment  field  has,  of  necessity,  been  limited  by  ethical 
and  practical  concerns  (Saxe,  Dougherty,  Esty,  and  Fine,  1983).  The  degree 
to  which  this  Is  a  limiting  factor  can  be  seen  by  the  fact  that  75%  of  2,231 
treatment  outcome  studies  reviewed  by  Goldstein,  Surber,  and  Wilner  (1984) 
did  not  make  use  of  control  of  any  kind.6’ 

The  perspective  taken  towards  methodological  design  and  data 
analysis  Issues  In  this  study  has  been  to  both  recognize  their  inherent 
limitations  as  they  are  currently  being  addressed,  and  to  acknowledge  the 

58  Crawford  and  Chalupsky  ( 1 977)  observe  tongue-in-cheek  that  "alcoholism  evaluation, 
viewed  most  charitably,  appears  somewhat  lacking  In  sophistication"  (p,  73). 

59  In  spite  of  literally  hundreds  of  studies  looking  for  predictor  variables  which  could  explain 
the  variance  In  outcome  variables,  the  majority  of  the  variance  remains  unexplained  (Cronkite 
and  Moos,  1980;  Billings  and  Moos,  1983;  and  Booth  andAnsarl,  1984). 

60  For  example,  see  Babble  ( 1 986)  or  Kerlinger  ( 1 986). 

61  The  2 ,23 1  outcome  studies  Involve  drug  abuse  and  mental  health  programs  In  addition  to 
programs  which  provide  alcoholism  treatment  services. 


Importance  of  a  number  of  creative  efforts  which  have  been  undertaken  to 
expand  the  utility  of  passive,  nonrandom,  correlational  designs.  In  the 
absence  of  experimental  and  quasl-experlmental  designs,  researchers,  using 
nonexperlmental  designs  have  used  a  number  of  applications  of  multiple 
regression  to  address  relationships  among  variables.62 


1.  Bivariate  analysis  36  66.7* 

2.  Multivariate  Analysis 

A.  Linear  Discriminant  5  9.2* 

B.  Multiple  Regression  9  16.7* 

3.  Other 

A.  Cross- Lagged  Panel63  2  3.7* 

B.  Path  Analysis64  2  3.7* 

l  54  100* 


As  passive  observational  designs,  with  one  exception,  all  studies 
reviewed  for  this  study  used  purposive  sampling,  without  control  groups.65 
The  search  for  predictors  of  outcome  is  by  definition  exploratory  in  nature. 


62  See  Pedhazur  ( 1 982)  for  a  concise  presentation  of  the  rationale  for  the  use  of  multiple 
regression  in  nonexperimental  settings  as  a  means  of  controlling  for  variance,  through  the  use  of 
partial  and  semi-partial  correlations  ( p.  98). 

63  Costello  ( 1 980)  used  both  and  contrasted  cross- lagged  panel  analysis  with  path  analysis. 

64  Path  analysis  will  not  be  discussed  in  this  paper.  In  general  terms  it  is  one  of  several  data 
analysis  techniques  which  attempt  to  address  causative  inference  in  passive  observational  designs 
(Cook  and  Campbell,  1979,  pp.  295-  340). 

65  Billings  and  Moos  ( 1 983)  stands  out  as  a  well  designed  study  which  used  random  assignment 
of  controls  and  their  families  to  look  at  recovery  processes  among  alcoholics  and  their  families. 


As  descriptive  designs,  most  of  the  studies  explore  relationships  among 
subgroups  In  their  sample  In  terms  of  the  relationships  between  one  or  more 
predictor  variables  and  selected  outcome  variables.  A  number  of  the  studies 
reported  tests  of  statistical  significance  and  less  frequently,  measures  of 
magnitude  to  assess  how  their  findings  might  differ  hypothetically  from 
relationships  which  could  have  been  randomly  generated.66 

While  multiple  regression  and  linear  discriminant  analysis  have  been 
used  to  statistically  control  for  variance  In  passive  observational  designs, 
cross-lagged  panel  analysis  allows  the  researcher  to  begin  to  comment  on 
the  directionality  of  observed  relationships  among  variables.  As  a 
descriptive  tool,  cross-lagged  panel  analysts  can  be  used  to  control  for 
alternative  or  competing  explanations  for  the  observed  relationships  among 
variables.  Used  predominantly  in  educational  psychology,  political  science, 
and  sociological  settings,  there  are  at  least  two  studies  which  have  used 
cross-lagged  panel  analysis  to  discuss  the  relationship  between  aftercare 
and  outcome  in  the  alcoholism  treatment  field  (Vannlcelll,  1978;  and 
Costello,  1980). 

It  must  be  stressed  that  the  results  of  a  cross-lagged  panel  analysis 
must  be  considered  provisional  In  nature  rather  than  confirmatory. 
Confirmation  of  any  findings  In  a  cross-lagged  panel  design  would  await 
replication  through  a  more  rigorous  experimental  design  (Kenney,  1975).  It 
Is  the  author's  opinion  that  the  specific  merit  of  a  cross-lagged  panel 
analysis  is  in  terms  of  Its  being  a  fairly  cost-effective  means  of 

66  The  use  of  tests  of  statistical  significance  In  this  manner  is  the  subject  of  some  discussion  in 
the  literature  and  will  be  addressed  in  more  detail  later  in  the  this  section. 


establishing  areas  for  further  research  for  which  the  substantial  Increases 
in  costs  for  an  experimental  design  could  then  be  Justified. 

The  statistical  analysis  Itself  may  Introduce  problems  regarding  the 
interpretation  of  the  findings.  Emrlck  and  Hansen  ( 1 983)  concluded  that 
specific  findings  may  be  "more  reflective  of  the  statistical  procedures  used 
than  a  true  (measure)  of  relative  predictive  strength"  (p.  1080).  This 
finding  was  based  on  Cronklte  and  Moos  ( 1 978)  observation  that  the  first 
variable  entered  In  a  multiple  regression  analysis  will  of  necessity  Include 
shared  variance  and  thus  overestimate  Its  contribution.  The  second  and 
later  variables  are  entered  on  the  basis  of  "unique,  explained  variance"  and 
do  not  reflect  shared  variance,  and  hence  tend  to  underestimate  their 
relative  explanatory  contributions”  (p.  1 106). 

Violation  of  statistical  assumptions,  for  the  most  part,  are  simply 
not  addressed  In  the  literature,  either  in  the  professional  journals,  or  more 
surprisingly,  In  doctoral  dissertations.  A  common  problem  for  resolution  is 
the  issue  of  the  assumption  of  the  normal  distribution.  The  normal 
distribution  of  subjects  along  the  variables  under  study  is  considered 
"necessary"  for  multiple  regression  and  many  of  the  tests  of  significance 
and  measures  of  magnitude  reported  In  the  literature. 

Two  variables  for  which  this  discussion  has  Immediate  relevance  are 
the  age  and  gender  distributions  of  alcoholic  subjects.67  Abusive  drinking 
patterns  and  associated  alcohol  problems  are  not  distributed  normally  but 
tend  to  be  concentrated  In  younger  adults  (Mendelson  and  Mello,  1 985; 

67  A  number  of  studies  have  shown  that  elevated  mortality  for  alcoholics  Is  not  uniform  for  all 
age  groups.  "Death  rates  for  younger  alcoholics  are  elevated  to  a  higher  degree  than  death  rates  for 
older  alcoholics”  (Pollch,  Armor,  and  Bralker,  1981 ,  p.  115). 


Cahalan,  1987).  Males68  are  significantly  overrepresented  which  has  led  one 
researcher  to  comment  that  alcohol  problems  might  be  more  appropriated 
characterized  as  problems  of  young  males  In  their  twenties  and  early 
thirties69 

The  conspicuous  absence  of  discussion  regarding  the  violation  of 
statistical  assumptions  suggested  to  the  author  that  the  Issue  was  far  from 
dormant  and  remains  to  more  effectively  be  addressed  by  the  research 
community.  The  strongest  rationale  for  the  use  of  multiple  regression  with 
data  which  violates  assumptions  regarding  the  normal  distribution  of  data 
were  expressed  by  Pedhazur  (1982)  who  reported  that  It  has  "been 
demonstrated  that  regression  analysis  was  generally  robust  In  the  presence 
of  departures  from  assumptions,  except  for  measurement  errors  and 
specification  errors70"  (p.  34). 

The  relative  effectiveness  of  multiple  regression  has  been 
commented  on  by  Ghlselll  (1983)  who  suggested  that  a  "correlational 
regression  approach  was  superior  to  clinical  observation  In  terms  of 
predicting  outcome"  (p.  651 ).  In  either  case,  the  recommended  guidance 
would  be  to  proceed  cautiously  and  conservatively  In  the  Interpretation  of 
the  findings.  This  last  point  is  particularly  germane  given  the  purposive 
sampling  and  comparison  of  nonrandom  subgroups  In  the  multiple  regression 

68  In  contrast,  a  conservative  estimate  of  the  "number  of  women  with  alcoholism  and  alcohol 
related  problems  has  been  estimated  to  be  about  20$  of  the  total  number  of  alcoholics  In  the 
United  States"  (Beckman,  1975  as  quoted  In  Mendelson  and  Mello,  1979,  p.  93). 

69  A  paraphrase  of  an  Informal  comment  by  Jones  Klncannon  during  classroom  discussion,  in 
Public  Health  5047:  Intervention/  Secondary  Prevention  of  Drug  Abuse  in  Adults,  Spring 
Quarter,  1987. 

78  Specification  errors  Involve  the  Inappropriate  use  of  models,  e.g, ,  a  linear  model  to  explain 
data  which  Is  clearly  nonlinear  (Pedha2ur,  1982,  p.  34). 
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designs  reviewed  for  this  study,  in  a  majority  of  the  studies  reviewed  the 
appropriate  level  of  generalization  would  have  to  remain  within  the  sample. 

The  discussion  so  far  has  focused  on  the  search  for  predictor 
variables.  There  are,  however,  issues  regarding  the  choice  of  criterion 
variables  to  be  used  as  measures  of  outcome.  The  first  issue  relates  to  the 
efficacy  of  using  sobriety  (abstinence  from  alcohol)  as  a  measure  of 
outcome.  Goldstein  et  al.  (1984)  reported  that  more  than  half  of  the  studies 
used  measures  of  alcohol  usage  as  the  "sole  outcome  Indicator"  (p.  488). 

This  perspective  Is  certainly  consistent  with  an  AA  model  of  treatment 
which  views  the  cessation  of  drinking  as  the  Immediate  goal.  From  the 
perspective  of  AA,  the  maintenance  of  sobriety  could  appropriately  be 
considered  a  measure  of  successful  outcome. 

The  problem  with  using  alcohol  usage  or  abstinence  as  the  only 
criterion  variable  Is  that  this  variable  has  not  been  shown  to  consistently 
correlate  with  Improvement  In  other  areas  of  functioning  (Finney,  Moos,  and 
Mewborn,  1 980;  and  Babor  et  al.,  1988).  The  empirical  data  are  confusing 
which  has  resulted  In  contradictory  conclusions  regarding  the  relationship 
between  sobriety  and  other  behavioral  outcomes  71  >72 

The  underlying  Issue  Is  the  recognition  of  the  concept  that  the 
majority  of  life’s  problems  tend  to  be  multiply  determined.  Consequently 
simply  establishing  a  state  of  abstinence  from  alcohol  "cannot  be  expected 

7 1  Billings  and  Moos  ( 1 983)  report  a  positive  relationship  between  “controlling  drinking  and 
functioning  in  nondrinking  areas"  ( p.  213).  Kammeier  and  Conley  ( 1 979)  found  a  strong 
association  between  "relative  abstinence  and  good  personal  adaptation  for  recovering  alcoholics" 

( p.  115).  In  contrast,  Bromet  and  Moos  ( 1 979)  found  that  there  were  few  meaningful  differences 
between  abstaining  and  moderate  drinking  alcoholics  (p.  1 87). 

72  Babor,  Dolinsky,  Rounsaville,  and  Jaffe  (1988)  concluded  that  "the  evidence  does  not 
clearly  support  either  the  unitary  (abstinence  only)  or  multidimensional  approaches  to  the 
characterization  of  treatment  outcome"  ( p.  168). 
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to  result  invariably  in  across-the-board  improvement"  in  all  of  the  related 
problem  areas  (Finney  et  al.,  1980,  p.  26).73  At  the  same  time  that 
researchers  were  calling  for  a  variety  of  outcome  measures  it  should  be 
noted  that  treatment  outcome  studies  have  not  found  substantial 
correlations  between  treatment  effects  and  other  measures  of  outcome. 
Thus,  it  was  somewhat  Ironic  that  Singer  (1983)  called  for  the  use  of 
multiple  outcome  measures  because  changes  due  to  treatment  effects  in 
other  areas  might  have  been  missed  or  not  substantiated  (p.  1 1 45).  in  some 
respects  this  call  for  multiple  outcome  measures  appears  to  be  somewhat 
of  a  statement  of  faith. 

The  absence  of  significant  relationships  between  treatment  effects 
and  other  measures  of  outcome  may  well  be  related  to  the  Issue  of  the  use 
of  global  assessments  rather  than  specific  measures  of  change.  Global 
assessments,  such  as  Improvement  In  health,  employment  status,  or  marital 
functioning  require  someone,  whether  it  Is  the  researcher  or  the  client,  to 
make  a  Judgement  or  express  an  opinion  about  whether  the  relevant  category 
has  been  achieved.  The  crux  of  the  matter  becomes  one  of  appropriately 
specifying  the  particular  criteria  for  making  the  determination.  Along  with 
the  selection  of  appropriate  criteria,  are  the  related  Issues  of  sensitivity  of 
criteria,  and  the  reliability  of  their  application  across  researchers,  in  a 
word,  many  of  the  problems  with  alternative  outcome  measures  are  the 


73  Clare  ( 1 976)  notes  that  the  Idea  that  theHach1evement  of  abstinence  will  necessarily 
produce  an  amelioration  of  the  alcoholic's  problems  Is  being  seriously  challenged"  ( p.  279). 
Similarly  Emrlck  and  Hansen  ( 1 983)  state  that  "because  of  the  nonorthogonal  relationships 
among  outcome  domains,  the  use  of  multiple  measures  is  essential"  (p.  1 084).  Arguing  from  an 
opposing  viewpoint,  Costello,  Balllargeon,  Blever ,  and  Bennett  ( 1 980)  observe  that  as  "abusive 
drinking  becomes  Integrally  Involved  in  a  lifestyle  that  has  various  negative  social  characteristics 
along  many  dimensions,  and  that  a  change  In  the  abusive  drinking  pattern  will  effect  a  positive 
change  along  these  other  dimensions"  ( p.  228). 
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Inappropriate,  Insensitive  measures  of  outcome  which  are  used  in  a  fashion 
which  prevents  replication  of  findings  from  one  study  to  the  next  (Gibbs  and 
Flanagan.  1977).74 

While  a  portion  of  the  reliability  of  a  measure  Is  directly  related  to 
Its  specificity  (Carmines  and  Zeller,  1979),  more  pragmatic  concerns  are 
also  In  operation.  For  example,  changes  in  physical  or  emotional  health 
status  are  difficult  to  measure  In  the  relatively  short  time  frame  of  most 
studies.  Having  successfully  completed  an  inpatient  treatment  program,  it 
might  be  expected  that  a  client's  health  might  not  deteriorate  immediately 
upon  the  resumption  of  drinking.  Similarly,  other  criterion  measures  occur 
with  such  relative  infrequency  that  It  is  difficult  to  obtain  a  large  enough 
sample  to  be  able  to  address  changes  in  certain  behaviors,  such  as  driving 
while  intoxicated  arrests  or  other  types  of  legal  problems. 

Schucklt,  Schwel,  and  Gold  (1986)  found  that  treatment  outcome  was 
more  successfully  predicted  using  complex  scores  rather  than  the  single 
criterion  measures.  "Emotional,  vocational,  physical,  Interpersonal  and 
social  outcomes  are  all  relevant  but  often  neglected"  domains  from  which 
creative  composite  measures  could  be  developed  (Goldstein  et  al.  1984, 
p.  482).  Parenthetically,  It  should  be  noted  that  an  Important  next  step 
would  be  to  validate  the  efficacy  of  the  composite  measures  of  outcome 
through  replication  of  findings  prior  to  concluding  that  the  measures  were, 
in  fact,  significant  expressions  of  outcome  behavior. 

74  Emrlck  and  Hansen  ( 1 983)  note  that  the  "size  ot  an  outcome  iigure  often  is  dependent  on  the 
criterion  selected  for  evaluation,  how  the  criterion  is  defined,  and  how  it  is  measured" 

( p.  1081).  Variation  in  performance  results  from  these  issues  rather  than  true  differences  in 
treatment  effectiveness  ( p.  1081). 
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The  articles  reviewed  for  this  study  appear  to  have  placed  more 
emphasis  on  the  search  for  predictors  of  outcome  than  on  developing 
alternative  criterion  measures  of  outcome.  In  part  this  may  be  a 
consequence  of  not  questioning  underlying  assumptions  of  a  model.  Rohan 
( 1 970),  quoted  In  Costello  et  al.  (1980),  suggested  the  problem  was  one  of 
overly  rigid  thinking  In  which  "abstinence  was  equated  with  adjustment  and 
return  to  drinking  was  equated  with  maladjustment"  (p.  224).  As  a  summary 
comment  on  the  relationship  between  sobriety  and  other  outcome  measures, 
Pattlson  (1966)  observed  that  while  abstinence  was  an  Important  variable, 
It  was  not  a  "sufficient  criterion  upon  which  to  measure  the  success  of 
treatment  intervention."75 

Researchers  have  tended  to  focus  on  alcoholics  In  treatment 


programs,  because  of  their  relative  availability  and  the  ease  with  which,  as 
a  group,  they  may  be  Identified.  It  is  assumed  that,  with  rare  exceptions, 
persons  undergoing  treatment  for  alcoholism  are  In  fact  properly  Identified 
as  alcoholics.  Studying  untreated  alcoholics  In  the  community  presents 
numerous  methodological  problems  which  will  not  be  addressed  here.76  The 
Intriguing  temptation  for  researchers  is  to  want  to  ask  how  representative 
are  their  samples  of  alcoholics  In  treatment  when  compared  with  the 
general  population?  The  Issue  Is  that  the  question  cannot  be  answered  due 
to  the  significant  limitations  In  generalization  noted  above. 

According  to  Mendelson  and  hello  (1985),  based  on  preliminary  data 
from  an  epidemiological  survey  sponsored  by  NIMH,  the  "best  estimate  is 
that  approximately  10  million  Americans  will  experience  alcoholism 


75  As  quoted  in  Costello,  1 980,  p,  224. 

75  See  Schucklt  ( 1 985)  for  a  good  overview  regarding  epidemiological  approaches  to  the  stud/ 
of  alcoholics  and  alcoholism  within  a  natural  community. 


sometime  during  their  lifetime  (p.  277).  The  size  of  the  affected  population 
was  consistent  with  Emrick  and  Hansen's  earlier  estimate  of  9-  13  million 
Americans  experiencing  problems  with  alcohol  abuse  or  alcohol 
dependence.77  The  problem  for  the  researcher  Is  that  only  a  very  small 
proportion  of  alcoholics  ever  go  through  treatment.  Emrick  and  Hansen 
(1983)  estimated  that  less  than  10%  ever  receive  formal  treatment. 
Obviously,  all  the  treatment  outcome  studies  are  narrowly  focused  on  a 
relatively  small  subgroup  of  the  total  population  of  alcoholics.  Even  with 
appropriate  sampling  designs  to  allow  for  wider  generalization,  we  simply 
do  not  have  a  very  clear  picture  of  what  happens  to  the  more  than  90%  of 
alcoholics  who  have  never  entered  formal  treatment.78 

Heckler  (1983)  stressed  the  importance  of  the  development  of  the 
emerging  model  which  appreciates  the  heterogeneity  of  alcoholics  and  takes 
Into  consideration  the  interdependent  and  multi-determined  nature  of 
alcohol  problems.  The  research  field  Is  moving  farther  away  from  the  AA 
model  of  alcoholism  as  a  unitary  phenomenon.79  Schucklt  et  al.  (1986) 
recommend  looking  at  diagnostic  subsets  of  alcoholics.  More  sophisticated 
means  of  data  analysis  will  be  called  for  as  it  becomes  increasingly 
apparent  that  existing  methods  are  not  adequate  to  deal  with  the  complexity 
of  the  relationships  of  variables  among  alcoholic  populations.  For  example, 
Cronklte  and  Moos  ( 1 978)  estimate  that  23%  -  40%  of  the  total  explained 


77  As  defined  bv  the  Diagnostic  and  Statistical  Manual  of  Mental  Disorders.  ( 3rd  ed.)  of  the 
American  Psychiatric  Association. 

78  A  landmark  exception  to  this  observation  Is  Valllant's  ( 1 983)  40  year  prospective  study  of 
males  in  Boston.  In  hi s  prospective  study.  Vaillant  was  able  to  follow  subjects  who  developed 
alcohol  problems,  whether  or  not  they  were  Identified  for  treatment. 

79  Even  In  a  unitary  model ,  the  "Interrelationships  among  sets  of  variables  may  change  with 
the  type  of  independent  variable  and  outcome  criterion  used  in  a  study  (Cronklte  and  Moos,  1 980, 
p.  315). 
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variance  is  shared  between "  patient-  related  and  program-related 
variables”  (p.  1118). 

What  happens  when  environmental  or  extra-treatment  variables  are 
added  into  the  picture?  Unfortunately,  the  use  of  sophisticated  data 
analytic  techniques  which  might  have  addressed  these  Issues  have  been 
limited  by  the  relative  quality  of  the  data.  Clearly,  It  seems  imperative 
that  high  quality  research  will  require  additional  Investment  of  resources  If 
we  are  going  to  extricate  alcohol  treatment  research  from  Its  present 
mediocre  level  of  functioning  In  which  It  appears  to  be  "stuck."  A  sustained 
commitment  of  time,  staff,  and  resources  are  a  prerequisite  to  the  design  of 
high  quality  prospective  studies. 

in  some  respects  research  Issues  can  be  categorized  by  those  studies 
which  test  hypotheses  using  as  rigorous  designs  as  possible,  and  other 
studies  which  attempt  to  generate  new  understanding  regarding  theoretical 
Issues  of  the  subject  of  study.  The  latter  have  tended  to  be  somewhat 
subsumed  by  the  former  In  the  search  for  experimental  methods  to  enhance 
the  general izablllty  of  findings.  Recently  Donovan,  Klvlahan,  and  Walker 
(1986)  have  made  a  strong  case  for  using  "a  posteriori"  correlational 
approaches  to  explicate  theoretical  relationships,  which  can  later  be 
subjected  to  more  rigorous  designs  during  the  theory  testing  stage.  Their 
argument  supports  the  larger  concept  of  grounding  theory  In  the  data,  using 
statistical  techniques  to  guide  decisions  regarding  the  significance  and 
Importance  of  the  relationships  observed  In  the  data. 
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There  are  four  validity  and  reliability  Issues  discussed  in  the 
literature  which  are  considered  timely  for  this  study: 

A.  self-reported  data. 

B.  data  reliability, 

C.  secondary  data. 

D.  external  validity. 

In  general,  the  discussion  generated  In  the  literature  has  led  to  a  consensus 
of  opinion.  In  several  Instances  contradictory  findings  were  noted  and  are 
reported  In  this  review.  As  relevant,  the  author  will  describe  in  this 
section  how  this  study  approached  the  specific  Issue  under  discussion. 

The  Issue  of  the  validity  of  self-reported  data  was  integral  to  this 
study.  While  a  number  of  stereotypic  Images  can  be  called  up  to  highlight 
the  significance  of  the  Issue,60-81  most  of  the  research  in  the  alcoholism 
treatment  field  "hinges  on  the  accuracy  of  these  reports"  (Watson, 
Tllleskjor,  Hoodecheck,  Pucel,  and  Jacobs,  1984,  p.  344).  There  are  four 
problems  which  have  been  Identified  with  self-reported  data:  conscious 
dishonesty  on  the  subjects'  part,  the  effects  of  denial,  the  immediate 

80  "Clients  were  viewed  as  socially  deviant  and  there  is  a  general  suspicion  that  they  may 
provide  distorted  information"  (Kruzlch,  1980,  p.  27).  The  author  was  not  able  to  find  any 
studies  which  addressed  the  presence  oi  ■'  'equency  of  negative  stereotypes  about  alcoholics  In  the 
general  public’s  mind  (or  clinicians’  minds  for  that  matter). 

8 1  Caetano  ( 1 987)  suggested  that  there  "Is  still  a  great  deal  of  ambiguity  In  the  public's  mind 
as  to  whether  alcoholism  is  a  disease  or  a  sign  of  moral  weakness "  ( p.  1 54). 


effects  of  Intoxication,  and  the  long-term  effects  of  organic  impairment 
due  to  alcohol  consumption. 

Conscious  lying  has  been  addressed  by  correlating  self-reports  with 
collateral  reports  from  a  variety  of  sources  ranging  from  spouse  to 
employer  and  therapist.  The  degree  of  correlation  depends  on  the  specific 
area  to  which  the  question  is  being  addressed.  Overall,  no  evidence  was 
found  to  suggest  that  alcoholic  clients,  when  taken  as  a  group,  consciously 
lie.82  What  was  found,  however,  Is  that  there  does  appear  to  be  a  strong 
directional  bias  In  the  answers  to  questions  about  alcohol  consumption.  In 
general,  when  compared  with  collateral  reports,  there  was  a  clear  trend  for 
alcoholics  to  underreport  consumption.83 

In  behavioral  areas  other  than  drinking,  reasonable  concordance 
between  alcoholic  self-reports  and  collateral  Interviews  were  noted. 
Watson  et  al.  (1984)  concluded  that  "alcoholics  are  unlikely  to  hide 
undesirable  Information”  (p.  345).  Several  studies  report  that  self-reported 
data  for  non-drinking  Items  tend  to  be  reported  accurately  (Sobell  and 
Sobell,  1978;  Malsto,  Sobell,  and  Sobell,  1979;  Sobell  and  Sobell,  1981; 
Watson  et  al.,  1984)84-88,  when  differences  between  subject  and  collateral 


82  An  example  of  the  absence  of  consensus  can  be  demonstrated  by  Goldstein ,  Surber ,  and 
Wllner  ( 1 984)  who  concluded  that  "self-reports  are  open  to  question  given  the  stigmatized 
behavior  in  question  as  well  as  the  client's  desire  to  please"  ( p.  482), 

83  It  should  be  clearly  noted,  however ,  that  the  underreporting  of  consumption  is  not  a  problem 
unique  to  alcoholics.  General  population  studies  have  found  the  same  phenomenon,  where  the  mean 
alcohol  intake  is  grossly  underreported  ( Poikolainen  and  KSrkkainen,  1 985).  In  the  general 
population,  the  relationship  between  actual  drinking  and  self-reports  is  curvilinear-  reasonably 
accurate  for  light  and  moderate  consumers  but  greatly  underreported  for  heavy  drinkers" 

( Popham  and  Schmidt,  1981, 358). 

84  With  the  exception  of  lower  scores  on  the  Michigan  Alcoholism  Screening  Test  ( MAST), 
Leonard,  Dunn  and  Jacob  ( 1 983)  found  significant  agreement  between  alcoholic  men  and  their 
spouses  in  a  variety  of  other  areas. 

88Freedberg  and  Johnston  ( 1 980)  found  high  levels  of  agreement  between  subject,  spouse,  and 
counselor  in  terms  of  self-reports  in  changes  in  the  subjects  drinking  behavior. 


self-reports  were  found,  they  tended  to  either  present  no  pattern,  or  were 
in  a  direction  where  the  subject  presented  him  or  herself  in  a  more  negative 
light  than  the  collateral  Interview  (Pollch,  Armor,and  Bralker,  1 980;  Sobell 
and  Sobell,  1981) 

Denial,  as  a  hypothesized  psychological  defense,  has  been  reported  in 
the  literature  as  the  means  by  which  the  alcoholic  is  able  to  deny  the 
reality  of  alcoholism  (Bean  and  Zlnberg,  1981;  and  Metgzer,  1988).  It  is 
Interesting  to  note,  that  none  of  the  studies  reviewed  considered  the 
possible  relationship  between  denial  and  the  validity  of  self-reports.86*87 
It  Is  reasonable  to  suggest  however,  that  If  such  a  psychological 
phenomenon  were  operating,  It  could  be  addressed  by  the  same  procedure  of 
comparing  subject  self-reports  with  a  variety  of  collateral  reports88 

Acute  intoxication  does  appear  to  have  an  effect  on  the  validity  of 
self-reported  data.  One  recent  study  found  that  heavy  drinkers  tend  to 
underestimate  the  amount  of  alcohol  consumed  (Malsto,  Sobell,  and  Sobell, 
1979).  The  Intoxicating  effects  of  alcohol  also  were  offered  as  one  reason 
for  the  curvilinear  relationship  noted  in  population  study  reports  of  alcohol 


86  The  absence  of  the  issue  in  the  discussion  of  validity  of  self-reports  is  even  more  surprising 
given  the  degree  to  which  "denial"  is  considered  to  be  pathognomonic  of  alcoholism  by  the 
alcoholism  treatment  community.  From  the  author's  perspective  it  is  exceptionally  ironic  in  that 
the  diagnosis  of  alcoholism  in  most  Instances  is  based  on  clients'  self-reported  history. 

87  On  the  other  hand,  one  might  expect  a  general  reluctance  among  empirically  based 
researchers,  who  have  undertaken  the  majority  of  the  validity  studies,  to  attempt  to  validate  an 
hypothesized  unconscious  phenomenon. 

88  An  alternative  explanation  for  why  denial  would  not  necessarily  effect  self-reported 
information  was  offered  by  Dr.  Norman  G.  Hoffmann,  Executive  Director  of  CATOR,  in  an  Informal 
conversation  with  the  author,  Denial ,  as  it  relates  to  alcoholism ,  is  denial  of  the  problem.  Not 
seeing  a  problem ,  the  active  alcoholic  would  not  be  able  to  see  the  connection  between  amount  and 
frequency  of  alcohol  consumed  and  the  resulting  diagnosis,  and  hence, would  be  more  likely  to 
report  accurate  Information  than  the  social  drinker  who  was  embarrassed  about  how  much  he  may 
have  consumed.  For  relatively  naive  alcoholics  this  position  was  consistent  with  the  author's 
clinical  experience.  For  alcoholics  who  have  "been  around  the  block  a  few  times,"  conscious 
dishonesty  was  more  of  an  issue  than  denial. 


w. 


consumption  discussed  above.  The  heavy  drinkers  do  not  remember  with 
clarity  the  actual  amounts  consumed.  Underreporting  was  “most  pronounced 
among  subjects  whose  drinking  was  described  by  collaterals  as 
uncontrolled"  (Watson  et  al.,  1984,  p.  348).89 

The  effect  of  chronic  organic  Impairment  secondary  to  alcohol 
consumption  on  self-reported  data  appears  to  be  self-evident.  Collateral 
interviews  offer  a  means  of  checking  the  validity  of  such  self-reports.  A 
common  method  reported  In  the  literature  for  dealing  with  this  Issue  was 
simply  to  exclude  subjects  with  obvious  organic  Impairment.  The  problem 
with  this  approach  Is  that  excluding  chronically  Impaired  subjects  to 
Improve  the  validity  and  reliability  of  the  study,  has  the  net  effect  of 
Inflating  the  success  rate  of  the  remaining  subjects  In  the  study  (Moos  and 
Bliss,  1978). 

The  majority  of  the  questions  used  by  CATOR  are  concerned  with 
nondrinking  behaviors.  Two  CATOR-1 1 1  questions  used  In  this  study  involve 
self-reported  Information  about  drinking  behavior.  The  first  question 
addresses  frequency  of  alcohol  consumption  (five  categories  from  never  to 
dally)  and  the  second  question  addresses  the  number  of  months  of 
abstinence  experienced  per  reporting  period.^  With  the  possible  exception 
of  the  two  questions  related  to  alcohol  usage,  the  literature  review  would 
suggest  that  the  self-reported  CATOR-tll  data  used  In  this  study  would  be 

89  Kruzlch  ( 1 980),  noting  that  correlations  between  self-reports  and  blood  alcohol 
concentration  tests  ( BAC)  are  still  reasonably  high  ( ranging  from  0.55  to  0.70)  that  the  self- 
reports  of  actively  drinking  subjects  mer/  be  considered  acceptable  ( p.  29). 

90  On  the  other  hand,  having  only  one  measure  of  alcohol  usage  can  be  considered  a  limitation  in 
the  construct  validity  of  this  study  in  terms  of  the  potential  for  "mono- method  bias"  ( Cook  and 
Campbell,  1979,  p.  66). 
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reasonably  accurate,  with  some  tendency  for  the  clients  to  portray 
themselves  more  conservatively  than  may  actually  be  the  case. 

The  validity  of  the  CATOR-lll  data  have  been  previously  addressed  by 
Hoffmann  and  Harrison  (1986).  They  noted  that  "Interviewers  asked 
questions  regarding  specific  behaviors  rather  than  framing  the  questions  in 
such  a  way  as  to  require  a  judgement,  attitude,  or  opinion"  (p.  48).  Research 
has  shown  that  questions  which  request  specific  Information  tend  to  elicit 
reasonably  accurate  Information,  even  when  It  Is  of  a  sensitive  nature 
(Sobell  and  Sobell,  1978).  Second,  CATOR  “routinely  selected  a  small 
random  sample  of  cases  and  Interviewed  both  subjects  and  a  significant 
other"  to  establish  the  validity  of  the  CATOR-lll  data  (Hoffmann  and 
Harrison,  1986,  p.  49) 

For  the  most  part,  reliability  estimates  In  the  alcoholism  treatment 
field  are  not  undertaken.  When  done,  a  discussion  of  reliability  is  most 
often  blended  with  the  discussion  of  validity  Issues  (Armor  et  al.(  1976; 
Kruzlch,  1 980 ).91  The  studies  which  have  looked  at  the  issue  of  reliability 
of  findings  have  tended  to  focus  on  relatively  short  follow-up  intervals 
between  test-  retest  of  specific  Instruments,  ranging  from  six  weeks  to 
three  months  (Guze  and  Goodwin,  1972;  Sobell,  Sobell,  and  Vanderspek, 
1979).  Noting  the  limitations  Inherent  In  any  study  of  reliability,  Shucklt 
(1985)  concluded  that  the  "reliability  of  most  alcohol  related  studies  was 
relatively  high,  and  that  distortion  of  results  occurring  from  decreased 
reliability  did  not  show  a  definite  pattern"  (p,  13),92 

9 1  "Probably  no  Issue  is  more  debated  among  behavioral  scientists  and  studied  less.. .than 
reliability" (Armor  eta!.,  1976,  p.  Ml). 

92  while  test-retest  measures  are  more  relevant  for  assessing  the  ability  of  instruments  to 
produce  the  same  results  across  time,  collateral  interviews  can  also  be  used  to  establish  the 
reliability  of  self-reported  data  across  time  (Babbie,  1986,  p.  109) 


The  reliability  of  the  CATOR-Ill  data  was  enhanced  by  several 
procedural  techniques.  Interviewers  received  Initial  and  periodic  update 
training  to  ensure  that  data  were  being  collected  according  to  CATOR 
procedures.  Telephone  Interviews  were  conducted  from  precoded 
questionnaires.  All  questions  were  field  tested  in  pretests  prior  to 
inclusion  in  the  CATOR  interview  to  ensure  that  the  intent  and  wording  of 
the  questions  were  clear  and  unambiguous.93  All  data  were  manually 
checked  for  completeness  and  accuracy  prior  to  being  entered  into  the 
computer  system.  The  data  were  entered  Into  the  computer  two  times  and 
were  verified.  The  data  entry  program  had  a  preset  range  of  data 
parameters  and  flagged  violations  for  future  reconciliation.  There  was  a 
specific  CATOR  protocol  to  be  followed  for  the  reconciliation  of  identified 
data-verif ication  violations.  A  conservative  approach  was  used,  and  when 
the  violation  could  not  be  reconciled  the  data  were  thrown  out.  The 
precoded  telephone  interview  forms  were  color  coded  to  insure  proper 
collection  and  entry  for  the  appropriate  time  interval. 

The  positive  aspect  of  a  secondary  data  analysis  is  having  access  to  a 
very  large  data  pool.  This  allowed  for  a  much  richer  description  of  the 
variables  and  their  relationships  than  could  be  accomplished  in  a  smaller 
sample,  collected  for  the  specific  purpose  of  addressing  the  research 
question  under  consideration.94  The  financial  constraints  simply  would  not 


93  Details  of  the  interviewer  training  procedures  summarized  from  a  conversation  with 
Patricia  Ann  Harrison,  CATOR  Research  Coordinator,  Summer  Quarter,  1 986. 

94  A  potential  problem  with  secondary  data  analysis  is  that  generalization  of  the  results  is  often 
totally  dependent  upon  the  design  of  the  primary  data  collection,  procedures  over  which  the 
researcher  conducting  the  secondary  data  ans’ysis  has  no  control. 


allow  an  Individual  researcher  to  collect  the  quantity  and  quality  of  data 
which  was  already  available  as  part  of  the  ongoing  efforts  at  CATOR 

A  potential  drawback  to  a  secondary  data  analysis,  Is  that  the 
researcher  has  to  work  within  the  limitations  of  the  primary  data  as  it 
exists.  For  example,  one  might  wish  that  the  CATOR-lll  data  had  included 
more  items  related  to  the  variables  of  interest  for  this  study  and  explored 
them  In  more  detail.  The  Issue  becomes  one  of  constructing  a  connection  or 
bridge  between  the  researcher's  conception  of  his  Interests  and  the 
available  data.  The  validity  Issue  becomes  one  of  assessing  the  degree  of 
fit  between  the  collected  data  and  the  variables  which  the  researcher 
wished  to  study.  The  creativity  of  a  secondary  data  analysis  becomes 
evident  In  the  design  of  an  analysis  which  allows  the  researcher  the 
opportunity  to  address  specific  concerns  within  the  limitations  imposed  by 
the  primary  data. 

As  discussed  In  the  last  section,  the  sample  of  CATOR-lll  subjects 
used  In  this  study  was  purposive  In  nature,  limited  to  those  clients  for 
whom  complete  data  were  collected  at  all  four  data  gathering  points  to 
obtain  maximum  understanding  of  the  relationships  among  the  variables 
being  studied.  It  can  be  expected  that  the  amount  of  motivation  required  to 
provide  extensive  follow-up  data  over  a  two-year  time  period  would 
probably  act  to  differentiate  this  sample  from  other  potential  CATOR-lll 
subsets  which  could  include  clients  for  whom  some,  but  not  all  data  were 
available. 

95  an  example,  according  to  CATOR's  Executive  Director ,  to  generate  a  comparable  data  set 

would  cost  an  estimated  $  1 50,000. 


External  validity  was  limited  in  terms  of  any  substantial 
generalization  of  the  results  to  other  samples.  The  large  and  rich  data  set 
provided  a  heterogeneous  sample  of  relatively  high  functioning  subjects 
from  many  different  situations  and  circumstances  in  the  upper  mldwestern 
United  States.96  While  acknowledging  the  limitations  regarding 
generalization  which  were  discussed  earlier  In  this  study,  It  should  be  noted 
that  the  CATOR-iil  data  presented  in  this  study  were  probably  more 
representative  of  mainstream  American  experiences  with  aftercare  and  AA 
than  the  majority  of  studies  cited  In  the  literature  review.97 

The  sampling  procedure  clearly  limited  the  external  validity  of  this 
particular  study.  The  stated  purpose  of  the  design  was  to  take  advantage  of 
the  rich  data  set  and  explore  relationships  among  variables  within  the 
sample.  In  this  Instance  a  decision  was  made  to  maximize  available 
Information  at  the  expense  of  general Izablllty.  Based  on  the  findings  of  this 
study,  another  sample  could  be  randomly  selected  from  the  CATOR-lll  data 
pool  to  both  replicate  these  findings  and  extend  the  generallzability  of  the 
study. 

This  study  has  extended  our  understanding  of  the  relationships  among 
variables  and  has  established  that  the  research  questions  were  Important 
and  should  be  extended  to  other  samples  both  within  and  beyond  the  CATOR 
population  (Bogdan  and  Blklen,  1982)."  The  results  of  this  study  were 

96  The  33  treatment  facilities  were  located  In  1 2  states,  from  which  the  clients  were 
discharged,  provided  a  broad  spectrum  of  treatment  experiences  for  the  clients. 

97  It  should  be  clearly  understood  that  this  conclusion  refers  to  descriptive  commentary  about 
the  sample  Itself,  rather  than  any  suggestion  that  Inferences  based  on  this  stud/  can  be  applied  to 
other  samples  ( If  there  were  any)  with  similar  demographic  characteristics.  In  this  regard  the 
cross-validation  of  the  multiple  regression  findings  is  particularly  germane  in  that  the  cross 
validation  does  act,  In  some  respects,  as  a  replication  of  the  original  findings  ( Kenney,  1 975). 

98  "Based  on  the  assumption  that  human  behavior  Is  not  random  or  Idiosyncratic,  some 
(qualitative)  researchers  do  not  think  of  generallzability  In  the  conventional  w a/.  They  concern 


particularly  applicable  to  a  discussion  about  generating  theory,  grounded  in 
empirical  data  rather  than  ideology. 


themselves  not  with  the  question  of  whether  their  findings  are  generalizable,  but  rather,  whether 
the  question  under  stud/  is  generalizable  to  other  settings  and  subjects  "  ( Bogdan  and  Biklen, 
1982,  p.  41). 


This  chapter  is  divided  into  three  parts.  The  first  part  presents  a 
concise  statement  of  the  central  research  theme  of  the  study.  A  model  is 
presented  in  Figure  l  which  shows  the  expected  relationships  among  the 
study  variables  and  serves  to  guide  the  analysis  of  the  CATOR-lil  data.  In 
the  second  section  of  the  chapter,  the  test  (predictor),  outcome,  and  control 
variables  are  Introduced.  Based  on  the  model  of  hypothesized  relationships 
among  the  study  variables,  the  third  section  sets  out  the  specific  research 
questions1  which  will  be  addressed  in  the  analysis  of  the  CATOR-lil  data. 


This  study  was  concerned  with  exploring  relationships  between  AA 
attendance  and  aftercare  attendance  and  their  correlation  with  selected 
outcome  variables,  measured  longitudinally  at  six-month  intervals  for  two 


1  The  eight  research  questions  suggested  specific  null  hypotheses  which  will  be  addressed  In 
detail  In  “Chapter  Six:  Discussion."  The  critical  values  for  rejecting  the  null  hypotheses  using 
the  appropriate  tests  of  statistical  significance  (either  the  Chi  Square  Test  or  the  F- Test, 
depending  on  the  level  of  the  data)  will  be  discussed  In  "Chapter  Four:  Methodology". 


years  following  the  subjects'  discharge  from  inpatient  chemical  dependency 
treatment  programs.  Did  the  subjects  attend  the  social  support  resources  to 
which  they  were  most  likely  referred,  and  did  this  attendance  correlate 
with  their  outcome  performance? 

A  review  of  the  literature  suggested  that  researchers  have  tended 
only  to  be  Interested  In  the  correlation  between  the  Inpatient  treatment 
program  efforts  on  behalf  of  the  client,  and  subsequent  changes  in  drinking 
behaviors  (Emrlck  and  Hansen,  1983).  It  has  only  been  In  recent  years  that 
other  outcome  variables  have  been  examined  as  the  differential  effect  of 
alcohol  problems  across  relatively  Independent  functional  dimensions  has 
begun  to  be  appreciated.2-3  The  effect  of  the  posthospitalization  social 
support  resources  on  outcome  functioning,  Independent  from  the  treatment 
effect  provided  by  the  Inpatient  treatment  experience, for  the  most  part,  has 
not  been  studied. 

A  number  of  the  studies  cited  in  the  literature  review  used  a  cross- 
sectional  design  to  obtain  a  "snapshot"  of  what  was  occurring  at  a 
particular  point  in  time  for  a  group  of  clients  .  A  substantially  smaller 
number  of  studies  used  a  longitudinal  design  but  tended  to  have  only  two 


2  The  studies  cited  in  the  literature  note  that  the  search  for  other  outcome  variables  was 
directed  by  two  factors.  The  first  influencing  factor  was  the  recognition  of  the  relatively  low 
percentage  of  variance  accounted  for  by  existing  outcome  variables.  The  second  factor  influencing 
this  search  was  the  observation  that  a  change  In  drinking  patterns  did  not  necessarily  correlate 
with  improvement  in  other  arras,  such  as  health  or  employment. 

3  It  is  the  author's  opinion  that,  with  the  exception  of  sobriety  as  an  outcome  variable,  the 
research  community  has  yet  to  demonstrate  that  alcoholism  treatment  and  other  outcome  variables 
are  correlated  in  any  significant  and  consistent  manner.  Alternative  outcome  variables  make 
intuitive  sense  from  a  multidetermined,  multidimensional  model  of  alcoholism.  The  problem  is 
that  the  research  strategies  as  of  yet  are  probably  not  sophisticated  enough  to  identify  and  separate 
the  various  components  which  contribute  to  successful  outcome  functioning  in  the  recovering 
alcoholic. 


data  collection  points  (e.g,  most  commonly,  6-months  and  12-  months).  This 
study  will  expand  on  the  earlier  work  by  looking  at  the  relationships 
between  test  and  outcome  variables  in  six  month  increments,  l.e.,  at  6- 
months,  1 2-months,  1 8-months  and  24-months. 

Figure  1  graphically  shows  the  relationships  between  the  four  types 
of  variables  examined  In  this  study  for  the  first  (6-month)  time  period.  A 
straight  line  Is  used  to  Indicate  hypothesized  correlative  relationships.  The 
arrows  refer  to  the  passage  of  time.  The  relationships  among  the  variables 
are  assumed  to  operate  In  a  similar  fashion  for  the  remaining  three  time 
periods  (12-months,  18-months,  and  24 -months).  Both  the  outcome 
variables  and  the  control  variables  were  selected  on  the  basis  of  either 
previous  research  conducted  by  others  or  the  author's  clinical  experience.4 
The  element  of  time  is  Incorporated  into  the  design  by  analyzing  the 
relationships  among  the  variables  within  each  of  the  six-month  time 
intervals.  For  obvious  reasons  CATOR-III  definitions  of  all  of  the  variables 
are  used  in  this  study.5  Appendix  A  lists  the  CATOR-III  items  and 
definitions  which  correspond  to  the  study  variables. 


4  The  original  motivation  for  selecting  the  variables  was  primarily  based  on  the  author's 
clinical  experiences.  A  review  of  the  literature  provided  further  justification  as  all  of  the 
variables  had  been  addressed  in  previous  research. 

5  As  discussed  ear  Her  in  this  study,  a  secondary  data  analysis  must  work  within  the  constraints 
provided  by  the  primary  data  source. 


Table  3  lists  the  specific  variables  examined  in  this  study  in  terms  of 
the  four  categories  Into  which  they  were  placed  In  the  model.  AA 
attendance  and  aftercare  attendance  were  Identified  as  the  two  predictor 
(test)  variables  which  were  correlated  with  the  control  variables  and  the 
outcome  variables.  Clinical  observation  of  clients  who  attend  AA  on  a 
frequent  basis  would  suggest  that  AA  functions  as  a  self-help  group.  This 
role  of  AA  functioning  as  a  social  support  system  has  been  documented  in 
the  literature. 

An  Important  part  of  an  aftercare  program  involves  educating  clients 
to  make  appropriate  use  of  a  broad  range  of  health  services  and  community 
support  services.  Although  not  as  clearly  defined  In  the  literature,  it  was 
apparent  that  aftercare  provided  temporary  social  support  in  addition  to  its 
primary  role  of  facilitating  the  transition  from  Inpatient  programs  back  to 
the  community.  Consequently  one  might  expect  to  see  similarities  In  the 
relationships  between  the  two  predictor  variables  In  their  correlation  with 
the  outcome  variables.. 

Current  research  suggested  that  several  other  variables  may 
differentially  influence  the  clients'  receptivity  for,  or  ability  to  attend, 
aftercare  services  or  AA.6  For  example,  AA,  as  a  support  group,  has  tended 

6  With  the  possible  exception  of  Jlndra  and  Forslund  ( 1 978) ,  a  qualitative,  ethnographic 
survey  of  AA  membership  to  expl icate  system  dynamics  of  the  AA  meeting  remains  to  be  done.  The 
AA  meeting  is  important  because  it  becomes  the  hub  of  an  important  extended  social  network  for 
recovering  alcoholics.  See  Robinson  ( 1 979)  for  a  theoretical  discussion  of  the  functions  of  an  AA 
meeting. 


to  be  thought  of  as  a  predominantly  middle-aged  group  of  males.7 8 9  Table  4 
preser  s  selected  results  of  the  last  three  AA  World  Services  surveys  of 
their  own  membership.  AA's  data  appears  to  support  the  observation  that 
age  and  gender  are  two  variables  which  could  have  an  Influence  on  AA 
attendance  rates. 

in  addition  to  age  and  gender,  the  six  other  control  variables 
identified  In  this  study  may  Influence  outcome,  perhaps  confounding  the 
relationships  between  the  aftercare  and  AA  variables  and  the  outcome 
variables.  By  taking  Into  account  the  potentially  confounding  variables,  the 
relationships  between  the  test  and  outcome  variables  were  more  clearly 
ascertained.*  This  study  looked  at  the  the  correlation  between  the  control 
variables  and  individually,  the  test  variables  and  selected  outcome 
variables  which  correlated  with  the  test  variables.  In  a  later  step  of  the 
data  analysis  the  control  variables  were  entered  into  multiple  regression 
equations,  and  a  discriminant  analysis  equation.^ 

"Employability"  and  "type  of  substance"  are  two  control  variables 
which  require  further  clarification.  "Employability"  is  a  variable  which  is  a 
dichotomous  classification  of  subjects  at  the  beginning  of  their  inpatient 


7  It  is  the  author's  Impression  that  AA  might  also  be  characterized  as  a  predominantly  white 
group.  AA  World  Services  does  not  report  ethnic  make-up  of  their  membership.  Access  to  medical 
and  support  services  have  been  demonstrated  to  be  effected  by  social  class  and  ethnic  differences 
(Westermeyer,  1982). 

8  Another  way  of  making  the  same  point  is  to  consider  that  all  of  the  subjects  In  this  study 
completed  Inpatient  treatment  programs  and  controlling  for  individual  differences  would  begin 
their  posthospitalization  experiences  on  equal  footing.  The  control  variables  would  be  eliminated 
as  possible  explanations  for  any  observed  differences  In  outcome  functioning,  leaving  only  the 
predictor  variables  and  probably  one  or  more  unknown  variables.  Following  this  line  of  thought, 
the  relevance  of  an  experimental  design  is  increasingly  apparent. 

9  An  alternative  approach  to  the  analysis  of  relationships  among  three  groupings  of  variables 
would  be  to  consider  analysis  of  covariance.  From  the  author's  perspective,  the  combination  of 
bivariate  analyses  and  multiple  regression  provided  a  more  naturally  intuitive  route  for 
explicating  the  relationships  among  variables. 
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chemical  dependency  treatment  Subjects  who  were  employed  full-time  or 
part-time,  or  who  were  unemployed' '  at  the  point  of  Intake  are  considered 
employable.  Clients  who  reported  themselves  to  be  homemakers,  students, 
disabled,  or  retired  were  considered  to  be  unemployable.'2  In  general  terms 
the  unemployable  category  would  be  much  less  likely  to  report  full-time  or 

Adapted  from  AA  world  Services  (1984).  "The  General  Service  Office  of  AA  has  surveyed 
their  membership  on  a  triennial  basis  since  1 968"  (AA  World  Services,  1 984,  p.  1 ). 

' '  Unemployed  subjects  were  considered  to  be  eligible  for  employment  and  therefore 
employable. 

' 2  The  shortcomings  of  this  variable  are  quite  evident.  In  defense  of  the  classification  scheme, 
It  does  follow  federal  guidelines  regarding  who  Is  considered  to  be  employable.  On  the  other  hand, 
students  and  retired  persons  move  in  and  out  of  the  employment  market  fairly  fluidly. 
Homemakers  are  Increasingly  a  part  of  the  employment  market,  and  from  a  sense  of  fair  play,  if 
from  no  other  criteria,  deserve  to  be  classified  other  than  unemployable.  When  CAT0R-III  clients 
answered  the  question  they  were  asked  to  provide  the  best  choice  which  represents  their  situation. 
Consequently  it  was  assumed  that  someone  who  reported  their  status  as  homemaker  would  be  more 
likely  to  remain  In  that  category  than  move  to  one  of  the  employable  categories.  Clearly  this  Is  a 
topic  for  further  stud/  Employment  data  Is  one  of  several  possible  Ph.D.  dissertations  which 
could  be  generated  through  further  analysis  of  the  CAT OR- 1 1 1  data  pool. 
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part-time  employment  or  to  enter  the  employment  market.  Including  them 
In  outcome  measures  of  employment  would  result  In  unrealistically  reduced 
levels  of  functioning  for  the  group. 

"Type  of  substance"  Is  a  variable  which  is  sensitive  to  the  increasing 
awareness  that  many  people  have  problems  with  more  than  one  chemical.13 
The  literature  suggested  that  persons  with  multiple  chemical  problems  have 
a  poorer  prognosis  than  persons  who  only  have  problems  with  alcohol.  If  the 
multiple  addictive  problems  are  not  identified  during  treatment,  clients 
might  only  be  substituting  chemicals  and  thus  erroneously  considered  to  be 
treatment  successes.  It  might  also  be  hypothesized  that  clients  with 
multiple  chemical  problems  might  require  longer  periods  of  follow-up 
services  focusing  on  specific  Issues  of  multiple  drug  abuse  (Bowen,  1987, 
p.  123). 

The  remaining  control  variables  are  fairly  self  evident.  "Marital 
status"  and  "years  of  education"  were  included  In  response  to  research 
which  has  shown  that  alcoholic  clients  who  have  natural  support  systems 
available  to  them  appear  to  have  a  better  prognosis.  Marita)  status  was 
indicative  of  the  presence  or  absence  of  family  support.  More  or  less 
education,  as  a  rough  measure  of  socioeconomic  status,  has  been  correlated 
with  successful  functioning,  access  to  supportive  services,  better  health 
care,  etc  (Pollch  et  a!,,  1981,  p.  272). 14  "Ethnicity"  was  Included  due  to  the 


1 3  For  detailed  discussion  of  drug  abuse  among  populations  considered  "alcoholic"  see 
Hesselbrock  et  al  ( 1 985)  or  Schuckit  ( 1 985B), 

1 4  As  noted  previously  by  Olbbs  and  Flanagan  ( 1 977),  there  were  no  variables  which  provided 
a  consistent  picture  regarding  their  Influence  on  outcome  functioning.  Level  of  education  has  been 
demonstrated  to  correlate  with  outcome  functioning  in  a  number  of  studies,  but  also  not  to 
correlate  with  outcome  functioning  in  other  studies.  This  lack  of  consistency  may  well  be  the 
effect  of  the  type  of  setting  in  which  the  study  is  being  conducted.  For  example,  in  a  sample  drawn 
from  a  state  hospital  population  where  the  level  of  education  is  uniformly  relatively  low,  one 
might  not  find  a  positive  correlation  with  outcome.  In  a  different  setting,  such  as  a  for-profit 
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considerable  variation  in  use  of  treatment  services  by  different  ethnic 
groups  reported  In  the  literature  (Westermeyer,  1982;  Lex,  1985).  As  the 
last  control  variable,  "previous  chemical  dependency"  treatment  has  been 
reported  to  correlate  with  a  poorer  outcome  prognosis  (Pollch  et  al.,  1981, 
p.  1 3 1 ;  and  Ornsteln  and  Cherepon,  1 985). 

Outcome  functioning  can  be  discussed  In  terms  of  a  number  of 
dimensions.  For  this  study  1 1  variables  were  chosen  from  five  general 
areas  of  employment,  health,  mental  health,  legal,  and  sobriety.  As  in  the 
case  of  the  control  variables,  the  decision  to  include  the  variables  was 
based  on  their  importance  In  the  review  of  literature,  availability  of 
information  from  CATOR,  and  their  interest  to  the  author.  For  the  most 
part  the  outcome  variables  are  fairly  self-evident  and  are  intuitive 
measures  of  successful  functioning.  Intuitively  It  makes  sense  that,  if  the 
predictor  and  Intervening  variables  have  been  effectively  identified,  they 
should  correlate  with  employment,  health  care,  legal  status,  etc. ’s 


treatment  program  where  there  Is  a  broader  range  of  educative  experiences,  the  correlation  with 
outcome  might  well  be  more  significant. 

15  if  the  Identified  variables  are,  In  fact,  effective  predictors  of  outcome,  then  It  makes  some 
sense  that  they  should  be  correlated  with  outcome  measures  which  have  been  shown  to  be 
reflective  of  successful  adaptation  to  chem  ical  dependency  problems.  If  the  correlations  cannot  be 
substantiated  between  the  predictor  variables  and  outcome  variables,  then  it  must  be  concluded 
that  either ,  the  expected  test  variables  were  not  effective  predictors  of  outcome,  or  the  model 
which  hypothesized  the  relationships  was  not  very  effective. 


LfeJj 


As  noted  earlier,  Figure  1  proposed  a  mode)  which  hypothesized 
relationships  among  the  variables  which  were  examined  in  this  study.  The 
purpose  of  explicating  the  model  was  to  provide  structure  for  the  data 
analyses  and  guidance  regarding  the  choice  of  research  questions  The  model 
represented  a  synthesis  of  Ideas  abstracted  from  the  literature  review  In 
the  second  chapter.  The  control  variables  were  expected  to  have  a  direct 
influence  on  who  attends  either  AA  or  aftercare.  Additionally,  the  control 
variables  were  also  expected  to  have  direct  Influence  on  the  outcome 
variables. 

From  an  examination  of  the  model  It  can  be  seen  that  the  central 
focus  of  this  study  was  on  the  relationships  between  AA  attendance, 
aftercare  and  the  outcome  variables,  taking  into  consideration  the  control 
variables.  Using  a  number  of  data  analytic  tools,  the  analyses  of  the 
CATOR-1 1 1  data  were  accomplished  by  addressing  the  following  eight 
research  questions: 

Question  1:  Was  there  a  significant  relationship  between  AA 
attendance  and  tho  control  variables? 

Null  Hypotheses:  For  each  time  period,  there  was  no 
relationship  between  attending  AA  and  each  of  the  eight  control 
variables.16 


1 6  The  null  hypotheses  are  stated  in  general  terms  rather  than  listing  each  specific  null 
hypothesis  In  order  to  avoid  laborious  repetition  and  conserve  space.  For  example,  for  the  first 
research  question  there  were  the  32  specific  hypotheses  ( 8  control  variables  X  4  time  periods). 
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Question  2:  Was  there  a  significant  relationship  between  aftercare 
attendance  and  the  control  variables? 

Null  Hypotheses:  For  each  time  period,  there  was  no 
relationship  between  attending  aftercare  and  each  of  the  eight 
control  variables. 


Question  3:  Were  there  significant  relationships  between  the  control 
variables  and  those  outcome  variables  for  which  significant 
relationships  with  the  test  variables  had  previously  been 
demonstrated? 

Null  Hypotheses:  For  each  time  period,  there  were  no 
relationships  between  the  outcome  variables  (for  which 
statistically  significant  relationships  with  the  test  variables 
had  previously  been  demonstrated)  and  each  of  the  eight  control 
variables. 


Question  4:  Was  there  a  relationship  between  AA  attendance  and  the 
outcome  variables? 

Null  Hypotheses:  For  each  time  period,  there  was  no 
relationship  between  attending  AA  and  each  of  the  eleven 
outcome  variables. 


Question  5:  Was  there  a  relationship  between  aftercare  attendance 
and  the  outcome  variables? 


Null  Hypotheses:  For  each  time  period,  there  was  no 
relationship  between  attending  aftercare  and  each  of  the  eleven 
outcome  variables. 


Question  6:  Does  cross-lagged  panel  analysis  enhance  our 
understanding  of  the  correlations  between  the  test  variables  and  the 
specific  outcome  variables  for  which  relationships  with  the  test 
variables  could  be  demonstrated? 


Null  Hypotheses:  For  each  comparison  of  time  periods  (6- 
months  with  12  months,  etc),  there  were  no  differences 
between  the  two  cross-lagged  correlations,  connecting  the  test 
variables  with  their  respective  outcome  variables. 


Null  Hypotheses:  For  each  comparison  of  time  periods  (6- 
months  with  12  months,  etc),  the  synchronous  correlation 
between  the  test  variables  and  outcome  variables  was 
spurious,  due  to  the  independent  influence  of  a  third  (unknown) 
variable. 


Question  7:  Do  the  test  variables  Improve  our  understanding  of  the 
variance  In  the  outcome  variables,  over  and  above  the  variance 
already  explained  by  the  control  variables? 


Null  Hypotheses:  For  each  time  period,  AA  attendance  did  not 
add  to  the  understanding  of  the  variance  in  the  outcome 
variables  when  the  control  variables  were  entered  first  into  a 
multiple  regression  equation. 


Null  Hypotheses:  For  each  time  period,  aftercare  attendance  did 
not  add  to  the  understanding  of  the  variance  In  the  outcome 
variables  when  the  control  variables  and  AA  attendance  were 
entered  first  Into  a  multiple  regression  equation. 


Question  8:  How  effective  was  a  model  (Figure  1 )  which  explained  the 
variance  in  the  outcome  variables  through  a  combination  of  test  and 
control  variables? 


Each  of  the  research  questions  (and  null  hypotheses)  were  answered  through 
analysis  of  the  CATOR-III  data  within  each  of  the  six-month  follow-up 
Intervals.  Trends  which  were  evident  In  the  data  across  the  time  Intervals 
were  addressed  descriptively.  The  next  chapter  will  discuss  the  specific 
methodological  approaches  to  the  analysis  of  the  data  which  were 
undertaken  in  this  study. 


This  chapter  is  divided  Into  three  sections.  The  first  section 
describes  the  development  and  operation  of  the  Chemical  Abuse/ Addiction 
Treatment  Outcome  Registry  of  St.  Paul  Minnesota,  which  provided  the  data 
for  this  secondary  data  analysis.  Following  a  description  of  the  procedure 
for  sample  selection,  the  study  sample  is  compared  with  the  population 
from  which  it  was  drawn.  Data  collection  procedures  are  reviewed  and  the 
creation  of  the  data  tape  and  system  file  for  this  study  are  briefly 
discussed. 

The  second  section  of  this  chapter  presents  an  overview  of  the  design 
of  the  secondary  data  analysis.  A  six-step  process  is  explicated  in  which 
the  data  analysis  moves  from  consideration  of  univariate  variables,  through 
bivariate  comparisons,  to  the  multivariate  data  analyses.  A  rationale  is 
presented  for  the  use  of  tests  of  statistical  significance  and  measures  of 
association  with  a  purposive  sample. 

The  chapter  concludes  with  a  discussion  of  a  construct  validity 
problem  encountered  with  one  of  the  test  variables.  In  the  early  stages  of 
the  data  analysis  it  became  evident  that  there  were  problems  with 
aftercare  as  a  construct.  After  a  short  discussion  of  the  inherent 
limitations  of  a  secondary  data  analysis,  a  description  of  the  efforts  taken 
to  Improve  the  construct  Is  presented. 


The  Chemical  Abuse/ Addiction  Treatment  Outcome  Registry  contracts 
with  chemical  dependency  treatment  programs  to  collect  and  analyze 
follow-up  data  and  provide  reports  about  discharged  clients  for  two  years 
following  the  clients’  discharge  from  their  respective  treatment  programs.1 
Founded  In  1979,  CATOR  began  as  a  collaborative  project  Involving  seven 
Minneapolis-  St.  Paul  area  treatment  centers  operating  under  the  aegis  of 
the  St.  Paul-Ramsey  Medical  Education  and  Research  Foundation.  Their 
original  mandate  was  to  "develop  and  Implement  a  project  that  would  assess 
the  effectiveness  of  treatment  for  chemical  dependency"  (Hoffmann  and 
Belllle,  1982,  p.  3). 

CATOR  has  evolved  over  the  years  In  terms  of  both  size  and 
methodological  sophistication.  Recognizing  that  program  evaluation  cannot 
be  "all  things  for  all  people,"  an  early  decision  was  made  to  limit  the  scope 
of  the  topics  which  would  be  addressed  to  those  for  which  specific, 
objective,  and  measurable  operational  definitions  could  be  developed. 
"Quality  of  life"  and  other  intangible  issues  were  felt  to  be  "beyond  the 
practical  scope  of  their  Initial  effort"  (Hoffmann  and  Belllle,  1982,  p.  6).2 

CATOR’s  view  of  their  role  has  changed  from  that  of  providing 
consultation  to  treatment  centers  Interested  In  conducting  their  own 

1  CATOR,  NormanG.  Hoffmann,  Ph.D.,  Executive  Director,  (612)  221-2740, 17West 
Exchange  Street,  Suite  420,  St.  Paul,  MN  55102. 

2  CATOR  discusses  the  concept  of  "planned  Inadequacy”,  by  which  they  mean  that  their  Initial 
product  ( In  1 980)  will  be  less  than  optimal  but  sufficient  to  meet  basic  needs”  ( Hoffmann  and 
Belllle,  1982,  p.  6). 


internal  follow-up  evaluation,  to  acting  as  a  centralized  patient  registry. 
Standardized  data  collection  instruments  are  utilized  and  Increasingly 
sophisticated  analytical  summary  reports  are  provided  to  their  clients.3 
CATOR's  growth  can  be  seen  in  the  changes  in  size  of  the  data  pool  from 
CATOR-I  to  CATOR-IV.  As  a  patient  registry  In  1980,  CATOR-I  Involved 
3,757  subjects  from  7  treatment  facilities  in  Minnesota,  By  1983  CATOR- 
lll  had  enrolled  13,000+  subjects  from  33  treatment  centers  in  12  states 
(Hoffmann,  Belllle,  and  McKenna,  1985,  p.  11).  Currently  CATOR-IV  has 
enrolled  more  than  20,000  subjects  and  now  includes  an  adolescent 
treatment  registry. 

The  data  for  this  study  were  collected  over  two  and  one  half  years 
from  January,  1983  through  July,  1985.  The  CATOR-I  II  population  at  the 
time  the  system  file  for  this  study  was  created  consisted  of  1 3, 1 53 
subjects  who  had  completed  two  years'  of  follow-up.4*5  From  the  available 
population  of  inpatients,  a  sample  of  2,950  Inpatients  was  selected  for 
whom  as  complete  data  as  possible  were  available.6  with  the  exception  of 
the  multiple  regression  analyses  and  the  discriminant  analyses,  this  sample 
of  2,950  provided  the  basis  for  the  majority  of  the  data  analyses  reported  in 
the  ensuing  chapters  of  this  study.  Using  a  random  selection  process,  the 
study  sample  was  In  turn  subdivided  Into  two  samples  of  l  ,435  subjects  and 

3  CATOR  presently  defines  itself  as  a  "fee-for-service  objective  clinical  auditor"  ( Harrison  and 
Hoffmann,  1987,  p.  10). 

4  The  system  file  for  this  study  was  created  In  September ,  1 987. 

5  The  CATOR  data  pool  consisted  of  1 3 , 1 53  subjects.  9 ,222  subjects  were  treated  on  an 
Inpatient  basis.  3,931  subjects  were  treated  on  an  outpatient  basts.  To  avoid  the  potentially 
confounding  effects  of  mixing  inpatients  and  outpatients,  this  study  looked  at  inpatients  only. 

6  For  a  number  of  variables  there  were  a  small  number  of  missing  cases  which  were  handled  tn 
the  analysis  of  the  data  by  excluding  the  Individual  from  the  analysis  under  consideration. 
Consequently  the  sample  N  varied  from  291 0  to  2950  depending  on  which  variables  were  being 
compared. 
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1,515  subjects  which  were  used,  respectively,  for  the  development  and 
cross-validation  of  the  results  of  the  multiple  regression  analyses. 


Table  5:  Comparison  of  the  CATOR-lll  Inpatient  Population  With  the 
Study  Sample  Along  Selected  Demographic  Variables? 


Percent  of  CATOR-lll  Percent  of 

Inpatient  Population  Study  Sample 

IM*  9.922) _ (N  =  2,950) 


L  Pender 


Male  70 

Female  30 

2,.Aqs 

Under  20  5 

20-  29  29 

30-  39  27 

40-  49  16 

50-59  12 

60+  11 

3.  Ethnicity 

White  93 

Hispanic  1 

Black  4 

Other  2 

4.  Education 

<  8  yrs  6 

9-  1 1  yrs  21 

1 2  yrs  40 

Over  12  yrs  33 


71 

29 


5 

25 

28 

18 

14 

10 


95 

1 

3 

1 


14 

38 

43 


7  Table  5  Is  adapted,  in  part,  from  three  tables  reported  In  Hoffmann  et  al.  ( 1 985,  pp,  1 7- 
20) 


« 

*1 


t* 


Single 

29 

23 

Divorced 

15 

11 

Separated 

6 

5 

Widowed 

4 

3 

Cohabit. 

3 

2 

Married 

43 

tc 

56 

-mDIOVmenl  o1 

Full-time 

LalUo 

52 

61 

Part-time 

6 

6 

Unemployed 

Retire/ 

23 

14 

Disabled 

10 

9 

Homemaker 

6 

6 

Student 

3 

4 

Table  5  shows  that  In  most  respects,  the  study  sample  was  roughly 
comparable  with  the  CATOR-1 1 1  Inpatient  population  in  terms  of 
demographic  similarity.  There  were  no  real  differences  in  terms  of  gender 
and  ethnicity.  Overall,  the  study  sample  tended  to  be  a  little  older  and 
slightly  better  educated  than  the  CATOR-1 1 1  Inpatient  population  from  which 
it  was  drawn.  In  comparison  with  the  CATOR-1 1 1  inpatient  population  as  a 
whole,  more  sample  subjects  were  married  or  employed  on  a  full-time  basis 
and  fewer  sample  subjects  were  divorced  or  unemployed. 

These  findings  were  certainly  consistent  with  the  earlier  stated 
expectation  that  the  requirements  for  Inclusion  in  the  sample  (i.e.,  complete 
data)  would  result  in  the  generation  of  a  study  sample  which  might  differ 
from  the  general  population  from  which  it  was  drawn.  As  noted  in  the 
literature  review,  the  variables  which  differentiated  the  study  sample  from 
the  CATOR-1 1 1  inpatient  population  (educational  level,  employment  status, 
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over  age  30,  and  marital  status)  have  been  shown  to  correlate  with  more 
successful  outcome  functioning8*9 * 11 

Each  treatment  program  affiliated  with  CATOR  provided  a  staff 
person  identified  as  the  CATOR  liaison  who  compiled  the  Intake,  history,  and 
discharge  summary  data  and  who,  each  month,  forwarded  the  new  cases  to 
CATOR's  central  office  for  further  verification  and  data  entry.  New  cases 
entered  the  system  each  month  and  were  followed  for  two  years.  In  this 
sense  the  CATOR-III  Inpatient  population  can  be  considered  to  be  dynamic 
rather  than  static  in  that  each  month  new  cases  entered  the  system  and 
completed  cases  exited  the  system. ,0 

All  of  the  follow-up  data  were  collected  at  a  centralized  location  by 
CATOR,  using  trained  telephone  Interviewers, who  utilized  a  standardized  66 
Item  Interview  protocol.  If  the  clients  were  unavailable,  the  written 
consent  obtained  during  the  clients'  inpatient  treatment  allowed  CATOR  to 
obtain  the  requisite  follow-up  information  from  a  significant  other  chosen 
by  the  client.  Approximately  20%  of  the  data  were  obtained  through 
Interviews  of  significant  others.  A  small  number  of  clients,  who  were  not 
able  to  be  reached  by  telephone,  were  contacted  by  mall  (Hoffmann  et  al., 
1985,  p.  14).n 

8  Although  beyond  the  scope  of  this  stud/,  one  might  expect  that  the  sampling  process  used  in 
this  study  would  yield  a  higher  functioning  sample  when  compared  with  the  CATOR-III  Inpatient 
population  on  a  variety  of  outcome  measures. 

9  As  argued  by  Pollch  et  al.  ( 1 98 1 )  successful  outcome  functioning  may  also  be  a  function  of 
follow-up  as  "successes"  were  more  easily  traceable  at  follow-up  as  a  concomitant  of  their 
improvement  (p.  33). 

1 0  The  Executive  Director ,  Research  Coordinator  and  Data  Base  Manager  shared  oversight 
responsibilities  for  maintaining  the  quality  of  the  data  pool. 

11  It  Is  unclear  what  the  effect  was,  If  any,  of  obtaining  data  from  a  variety  of  sources. 

Certainly  multiple  sources  of  data  enhanced  the  overall  return  rate.  Collateral  Interviews  have 
been  previously  discussed.  Sobeil  and  Sobell  (1981)  compared  "client-interviews"  with  "client- 
completed  questionnaires"  and  found  no  significant  differences  In  the  reliability  of  data.  An 


The  resulting  data  were  coded  at  CATOR  and  stored  as  computer 
files. rc  The  data  tape  for  this  study  was  created  by  downloading  all  of  the 
CATOR-Ill  Inpatients  who  had  completed  two  years'  follow-up  and  selecting 
for  inclusion  In  the  study  sample  only  those  subjects  who  had  been 
successfully  contacted  and  Interviewed  at  all  four  follow-up  Interviews.13 
At  the  same  time  the  data  tape  was  created,  a  system  file  was  also 
generated  to  allow  for  more  expeditious  use  of  computer  resources  by 
including  only  those  variables  which  would  be  used  In  this  study.  See 
Appendix  A  for  a  list  of  CATOR  protocol  Items  used  In  this  study. 


Interesting  topic  for  further  stud/  would  be  to  explore  the  effect  of  the  multiple  data  sources  on 
the  validity  and  reliability  of  the  CATOR  data. 

1 2  See  the  earlier  discussion  in  the  second  chapter  regarding  the  reliability  of  the  data  and 
CATOR's  procedural  checks  to  Insure  that  the  data  were  properly  coded  and  transferred  to  the 
computer  files. 

1 3  For  the  purpose  of  data  analysis,  subjects  were  aggregated  at  the  point  of  follow-up.  As  an 
example,  all  subjects'  six-month  responses  were  aggregated,  regardless  of  when  the  six-month 
Interview  took  place  between  1 983  aid  1 985. 


The  design  of  the  secondary  analysts  of  the  CATOR  data  involved  a 
six-step  process,  moving  from  univariate  analysis  through  bivariate 
analysis  to  multivariate  analysis.14-15  Step  one  of  the  design  looked  at  the 
frequency  distributions  of  the  variables  to  check  on  the  reliability  of  the 
data  and  to  comment  on  patterns  In  the  manner  in  which  the  data  were 
distributed  along  the  variables,  in  step  two,  the  bivariate  relationships 
among  the  test-outcome,  test-control  variables,  and  selected  outcome- 
control  variables  were  analyzed.16  Building  on  the  results  of  step  two,  step 
three  used  cross-lagged  panel  analysis  to  further  assess  the  bivariate 
relationship  between  the  test  variables  (AA  attendance  and  aftercare 
attendance)  and  sobriety,  the  one  outcome  variable  which  was  found  to  be 
significantly  correlated  with  the  test  variables. 

Using  multiple  regression  analysis,  step  four  addressed  the  relative 
contribution  of  the  control  variables  and  the  test  variables  to  sobriety  as  an 
outcome  variable.  The  Integral  Issue  addressed  by  this  step  was  whether 
AA  attendance  and  aftercare  added  to  our  understanding  of  the  variance  in 
the  outcome  variable,  after  all  of  the  effects  of  the  control  variables  had 
been  taken  into  account.  Step  five  cross-validated  the  multiple  regression 

1 4  The  data  analysis  was  made  possible  by  a  $2,450  grant  for  computer  time  from  The 
Academic  Computing  Services  and  Systems  of  the  University  of  Minnesota 

1 5  The  statistical  analysis  was  accomplished  through  use  of  a  variety  of  subprograms  of  the 
Statistical  Package  for  the  Social  Sciences  (SPSS). 

1 6  The  focus  of  this  stud/  Is  on  the  relationships  between  the  two  test  variables  and  the  outcome 
measures.  Relationships  between  the  control  variables  and  outcome  variables  which  did  not  show  a 
significant  relationship  with  the  test  variables  were  felt  to  be  beyond  the  scope  of  this  study. 


findings  developed  in  step  four.  Finally,  in  step  six,  discriminant  analysis 
was  used  to  assess  the  relative  efficacy  of  the  model  used  to  explain 
sobriety  outcomes  in  terms  of  the  selected  control  and  test  variables.  This 
approach  to  a  secondary  data  analysis  of  the  CATOR-lll  data  yielded 
additional  insight  into  the  relationships  among  the  study  variables  and, 
more  importantly,  pointed  out  design  limitations  and  limitations  regarding 
our  current  level  of  understanding  of  posttreatment  adjustment  Issues  in 
the  chemical  dependency  field.17 

As  the  first  step,  frequency  distributions  were  calculated  for 
relevant  test  and  control  variables  to  check  for  blatant  coding  or  data  entry 
errors.18  The  frequency  distributions  also  allowed  for  comments  regarding 
the  shape  of  the  distribution,  whether  the  data  were  distributed  normally 
across  the  variable,  or  biased  In  the  direction  of  specific  values  of  the 
variable.  In  a  similar  fashion  the  crosstabulatlon  tables  were  also  used  as  a 
further  check  for  data  entry  errors  (Norusls,  1983,  p.  50). 

The  second  step  In  the  data  analysis  Involved  a  series  of  bivariate 
analyses  among  the  test  and  outcome  variables,  and  selected  comparisons 
with  the  control  variables  (See  Tables  6,7,  and  8).  Crosstabulatlon  tables 
were  set  up  to  explicate  the  bivariate  relationships  In  terms  of  how 
subjects  were  Jointly  distributed  among  the  various  bivariate  combinations 
(Nle  et  al.,  1975).  The  chi-square  test  (X2)  was  chosen  to  assess  whether 

1 7  As  will  be  discussed  In  more  detail,  the  "bottom  line"  was  the  recognition  that  the  majority 
of  variance  In  the  outcome  variable  ( singular)  remained  to  be  explained.  A  significant 
relationship  between  the  test  variables  and  a  multivariate,  multidimensional  perspective  of 
outcome  measures  was  not  supported  by  the  findings  of  this  stud/. 

1 8  However ,  it  should  be  pointed  out  that  one  of  the  potential  difficulties  involved  in  a  secondary 
data  analysis  is  the  difficulty  In  differentiating  Interviewing,  coding,  or  data  entry  errors. 

(Klecolt  and  Nathan,  1985), 
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1.  age 

2.  sex 

3.  marital  status 

4.  ethnicity 

5.  employability 

6.  previous  CD  Tx 

7.  type  of  substance 

8.  education 


1.  AA  Attendance 

2.  Aftercare 


1.  age 

2.  sex 

3.  marital  status 

4.  ethnicity 

5.  employability 

6.  previous  CD  Tx 

7.  type  of  substance 

8.  eduction 


1.  sobriety 


1 9  The  Test  variables  were  treated  separately  in  the  bivariate  analyses. 

2°  Only  those  outcome  variables  which  had  previously  demonstrated  a  statistically  significant 
relationship  with  the  test  variables  were  looked  at  in  terms  of  the  control  variables. 


1.  M  attendance  1,  sobrtety 

2.  Aftercare  2.  full-time  employment 

3.  part-time  employment 

4.  welfare  assistance 

5.  disability  assistance 

6.  injuries 

7.  medical  hospitalization 

8.  emotional  hospitalization 

9.  ER  visits 

10.  misdemeanors 

1 1 .  felonies 


the  two  variables  "operated  independently  from  one  another"  or,  whether  the 
X2  test  was  indicative  of  a  statistically  significant  relationship  between 
the  variables  (Howell,  1982,  p.  97)21*22  As  the  chi-square  test  Is 
particularly  sensitive  to  large  sample  size,  depending  on  the  number  of 
categories,  either  phi  (0)  or  Cramer's  V  were  also  reported  as  a  measure  of 
the  strength  of  the  relationship  between  the  two  variables23*24  In 


2 1  "Small  values  of  chi-square  indicated  the  absence  of  a  relationship.  A  large  chi-square 
implied  that  a  systematic  relationship  of  some  sort  existed  between  the  variables"  ( Nie,  Hull , 
Jenkins,  Stelnbrenner ,  and  Brent,  1975,  p.  224). 

22  The  chi-square  test  required  that  two  assumptions  be  met.  The  first  was  that  the  "each 
individual  observed  contributed  a  single  entry  to  the  joint  frequency  table.  The  second  assumption 
was  that,  for  tables  with  more  than  a  single  degree  of  freedom,  a  minimum  cell  frequency  of  five 
was  necessary  to  be  regarded  as  adequate"  ( Hays ,  1 98 1 ,  p.  305 ). 

23  very  large  samples  can  generate  many  statistically  significant  X2  results  which  are 
meaningless  in  terms  of  the  magnitude  of  association,  which  may  be  very  small  even  though 
unquestionably  "statistically  significant."  (Hays,  1981 ;  and  Howell,  1982). 

24  Cramer’s  V  can  range  between  0  and +  1.  "A  large  value  would  signify  that  a  high  degree  of 
association  exists  without  revealing  the  manner  In  which  the  variables  were  associated"  ( Nie  et 
al.,  1975,  p.  224). 
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situations  where  variables  Involved  interval  data,  the  data  were  grouped 
Into  logical  categories  and  treated  as  categorical  data.25 

For  the  bivariate  analyses,  subjects  were  classified  into  groups  on 
the  basis  of  their  reported  responses  on  the  specific  Independent  variables 
being  considered.  The  ex  post  facto  creation  of  comparison  groups  (e  g.,  AA 
attenders  versus  AA  non-attenders)  for  the  purpose  of  data  analysis  clearly 
did  not  Involve  either  random  sampling  or  random  assignment.  Blalock 
( 1 972),  Gllsson  ( 1 985),  and  Rubin  and  Conway  ( 1 985),  have  argued  the 
legitimacy  of  using  tests  of  statistical  significance  to  assess  relationships 
with  both  purposive  samples  and  also  with  population  data.  Following  their 
logic,  the  relationships  between  the  Independent  and  dependent  variables 
were  assessed  by  tests  of  statistical  significance. 

Rather  than  using  the  tests  of  statistical  significance  to  comment  on 
the  probability  that  specific  relationships  might  occur  in  reality,  when  used 
with  a  purposive  sample  such  as  used  in  this  study,  tests  of  statistical 
significance  provide  a  means  of  assessing  whether  the  observed  results 
within  the  study  sample  could  be  attributed  to  random  association.2^  Only 
those  X2  tests  which  produced  a  critical  value  at  or  <;  0.01  were  considered 
to  be  significant.27 

25  While  Interval  variables  were  collapsed  into  logical  categories  for  the  bivariate  analyses, 
the  interval  variables  retained  their  "Interval"  quality  during  the  multiple  regression  analyses. 

25  That  is  to  s a/  that  the  observed  relationship  between  the  Independent  variable  and  the 
dependent  variable  could  be  explained  by  a  model  which  dictated  that  any  association  between  the 
two  variables  was  the  result  of  random  error  or  random  fluctuation  rather  than  an  actual 
relationship.  The  significance  test  provided  an  estimate  of  the  probability  of  this  random 
fluctuation  in  the  observed  effect. (Gllsson,  1985,  pp.  377-  386). 

27  See  more  detailed  discussion  later  In  this  chapter  regarding  the  use  of  conservative  critical 
values  for  the  purpose  of  controlling  for  the  possibility  of  spurious  relationships  resulting  from  a 
large  sample  size. 
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Obviously,  if  the  observed  results  could  be  attributed,  at  least 
hypothetically,  to  haphazard,  nonsystematlc  variation  in  the  relatlonsh'p 
between  the  variables,  it  would  be  expedient  to  use  caution  in  the 
interpretation  of  the  results.  In  a  similar  manner,  within  the  sample,  tests 
of  the  magnitude  of  association  were  presented  to  assess  the  percentage  of 
variance  in  the  outcome  variables  explained  by  the  independent  variables.20 
Tests  of  the  magnitude  of  association  (and  measures  of  association)  were 
used  to  assess  the  relative  Importance  of  statistically  significant 
relationships. 

Table  7  lists  the  comparisons  between  the  control  variables  and  the 
one  outcome  variable  for  which  a  statistically  significant  relationship  with 
the  two  test  variables  across  the  four  follow-up  time  periods  of  this  study 
were  demonstrated  The  control  variables  were  of  interest  only  within  the 
context  of  a  previously  demonstrated  significant  relationship  between  a 
test  variable  and  an  outcome  variable.  While  the  correlations  between  the 
remaining  outcome  variables, which  did  not  demonstrate  a  statistically 
significant  relationship  with  the  test  variables,  and  the  control  variables  is 
certainly  a  topic  of  Interest,  It  was  considered,  for  practical  and  financial 
considerations,  to  be  beyond  the  immediate  scope  of  this  study. 

In  the  third  step  of  this  design,  cross-lagged  panel  analysis  was  used 
to  take  advantage  of  the  element  of  time  and  discuss  the  relationships 
among  the  zero  order  bivariate  correlations  between  the  test  variables  and 


28  See  footnote (24)  in  the  next  chapter  which  discusses  a  decision  use  contingency  tables  ( with 
X2  and  t  or  Cramer’s  V)  rather  than  ANOVAs  (with  F-tests  and  R2). 


sobriety,  observed  over  tlme.29,30  The  basic  assumption  underlying  cross- 
lagged  panel  analysis  Is  that  the  repeated  measurement  of  the  same  two 
variables  over  time  potentially  should  provide  Information  about  the 
direction  of  any  causal  asymmetries  between  the  two  variables  (Cook  and 
Campbell,  1979,  p.  309).  Two  Issues  (See  Figure  2)  are  addressed  by  cross- 
lagged  panel  analysis.  The  first  Is  "whether  ‘A’  is  a  stronger  cause  of  'B' 
than  'B'  Is  of  'A'"  (p.  309).31  The  second  Is  whether  "C"  is  creating  a 
spurious  relationship  between  “A"  and  "B.” 

Figure  2  diagrams  possible  causal  relationships  between  two 
variables  for  which  a  statistically  significant  synchronous  correlation  has 
been  Identified.  Covariation  Is  a  necessary  but  not  sufficient  condition  to 
attribute  causation.  Assuming  that  a  relatively  stable  relationship  can  be 
demonstrated  across  a  time  interval,  cross-lagged  panel  analysis  allows  for 
comments  regarding  possible  directionality  of  the  relationship  as  well  as 
whether  an  extraneous  variable  Is  Influencing  variables  "A"  and  "B“  giving 
the  appearance  of  a  relationship,  which  Is,  in  fact,  spurious. 

Kenny  (1975)  felt  that  cross-lagged  panel  analysis  provided  a  means 
to  extend  the  discussion  of  a  correlational  relationship  between  two 
variables  by  ruling  out  plausible  alternative  explanations  of  a  causal  effect 

29  Sobriety  was  the  only  outcome  variable  to  consistently  demonstrate,  over  time,  a 
statistically  significant  relationship  with  the  test  variables. 

30  A  panel  stud/  uses  data  collected  from  the  same  group  of  subjects  at  two  or  more  points  in 
time  (Markus,  1979,  p.  7).  Cross- lag  is  a  statistical  technique  using  simple  correlations  to 
comment  on  the  relationship  between  two  variables  by  observing  how  the  correlation  coefficients 
change  when  one  variable  Is  lagged  behind  the  other. 

3 1  It  should  be  emphasized  that  correlation  Is  concerned  with  the  covariation  of  variables  and 
not  causal  relationships.  Both  cross- lagged  panel  analysis  and  path  analysis  are  correlative 
techniques  which  attempt  to  further  hypothesize  about  relationships  among  variables  in  terms  of 
possible  direction  of  relationships. 


Kvrsrr  w«rr  v* 


91  ] 

i 

due  to  spurlousness.32  "An  equality  in  the  cross-lagged  correlations  would  ! 

suggest  the  relationship  between  "A"  and  "B”  was  due  to  an  unmeasured  third 
variable"  (p.  889). 

I 

Figure  2:  Diagram  of  the  Question  Regarding  Causality  in 
a  Correlative  Relationship  Between  Two  Variables  Addressed 

by  Cross-Lagged  Panel  Analysis  ( 

i 

I 


? 


Both  Vannicelli  (1978)  and  Costello  (1980)  have  used  cross- lagged 
panel  analysis  In  the  more  specific  sense,  described  by  Rozelle  and  Campbell 
(1969),  to  conclude  that  the  temporal  asymmetry  observed  In  the  cross- 


32  Kenny  noted  that  the  chief  alternative  explanation  of  any  causal  effect  is  spuriousness. 
"Almost  any  statistical  relationship  can  be  attributed  not  to  causality  but  to  spuriousness" 

(p.  888). 


lagged  correlations  suggested  a  causal  relationship  between  the  test  and 
outcome  variable,33 

True  experiments  control  for  spurious  relationships  through  random 
assignment  of  subjects  to  treatment  and  control  groups  (Kenny,  1975), 
Vannlcelll  (1978)  and  Costello  (1980),  using  passive  observational  designs 
based  on  procedures  explicated  by  Kenny  ( 1 975)  and  Cook  and  Campbell 
(1979),  have  used  cross-lagged  panel  analysis  or  path  analysis34-35  to 
suggest  a  method  for  at  least  partially  controlling  for  the  spurious  effects 
of  an  unknown  or  unmeasured  third  variable  and  commenting  on  the 
directionality  of  relationships  (Costello,  1980;  Vannlcelll,  1978). 

In  cross-lagged  panel  analysis  (see  Figure  3),  the  assumption  is  that  if  the 
test  variable  truly  influences  the  outcome  variable,  the  cross-lagged 
correlation  coefficient  (rtio2>  lagging  the  test  variable  at  "t lme-1"  behind 
the  outcome  variable  at  "time-2"  should  be  greater  than  the  cross-lagged 
correlation  coefficient  (r0it2)  lagging  the  outcome  variable  at  "tlme-r 


33  Through  analysis  of  the  cross- lagged  correlations,  Cook  and  Campbell  ( 1 979)  suggested  that 
It  might  be  possible  to  "Infer  causal  processes  based  on  observations  of  concomitances  and 
sequences  as  they  occur  In  natural  settings  without  the  advantage  of  deliberate  manipulation  and 
controls  of  an  experimental  design  to  rule  out  extraneous  causal  Influences"  ( p.  295). 

34  Path  analysis  is  a  "causal"  model  for  understanding  relationships  between  correlated 
variables  ( Babbie,  1 986,  p.  433).  Recently  Costello  ( 1 980)  contrasted  the  efficacy  of  cross- 
lagged  panel  analysis  and  path  analysis  for  commenting  on  the  relationship  between  aftercare  and 
outcome.  Other  than  to  mention  that  it  exists  as  an  alternative  for  data  analysis,  path  analysis  will 
not  be  discussed  in  this  study, 

35  Costello  argued  persuasively  for  the  superiority  of  path  analysis  in  explicating 
directionality  among  variables  when  compared  to  cross-  lagged  panel  analysis.  The  author  chose 
the  cross-lagged  panel  analysis  as  being  more  appropriate  for  an  exploration  of  relationships 
among  variables.  A  basic  assumption  for  path  analysis  is  that  the  researcher  must  have  an 
explicit  model  accounting  for  all  relationships  among  all  relevant  variables.  Given  that  we  do  not 
have  a  clear  understanding  regarding  all  of  the  posttreatment  variables  contributing  to  outcome,  it 
Is  quite  likely  one  would  make  serious  specification  errors  which  would,  in  turn,  Invalidate  the 
results  of  path  analysis.  (Cook  and  Campbell,  1979;  Pedhazur,  1982;  and  Rossi,  Wright,  and 
Anderson,  1983). 


behind  the  test  variable  at  "time-2."36  If  the  test  variable  Influences 
outcome,  the  cross-lagged  correlation  (E)  should  be  larger  than  the  cross- 
lagged  correlation  (F),  In  contrast,  If  outcome  influences  the  test  variable, 
the  cross-lagged  correlation  (F)  should  be  larger  than  the  cross-lagged 
correlation  (E).  If  the  two  cross-lagged  correlations  are  equal,  the 
researcher  must  conclude  that  there  Is  no  relationship  between  the 
variables  and  that  the  apparent  synchronous  correlation  Is  due  to  the 
spurious  effect  of  an  unknown  third  variable. 

Kenny  (1975)  urges  caution  In  the  use  of  this  procedure.37-30  He  sees 
cross-lagged  panel  analysis  as  "an  exploratory  strategy  of  data  analysis,  for 
use  In  uncovering  simple  causal  relationships  between  uncontrolled 
variables"  (p.  901 ).  Following  successful  replication  of  the  above,  Kenny 
would  recommend  that  further  confirmation  be  through  a  formal 
experimental  design.  The  significance  test  (z  test)  for  a  cross-lagged  panel 
correlation  was  developed  by  Peters  and  VanVoorhls  In  1940  and  cited  In 
detail  In  Kenny  &  Only  those  z  tests  which  produced  a  critical  value  at  a  s 
0.01  were  considered  to  be  significant 


36  rt  i  o2  refers  to  the  zero-order  correlation  between  the  test  variable  at  time \  and  the 
outcome  variable  at  time2-  ro  1 12  refers  to  the  zero-order  correlation  between  the  test  variable 
at  time2  and  the  outcome  variable  at  time  \ .  In  rt  io2  the  test  variable  is  lagged  behind  the 
outcome  variable.  In  ro  1 12  the  outcome  variable  is  lagged  behind  the  test  variable. 

37  Both  the  synchronous  correlations  and  the  autocorrelations  must  demonstrate  stability  over 
time,  allowing  for  some  temporal  erosion  in  the  size  of  the  correlations,  to  permit  comments  about 
the  cross- lagged  correlations  (Cook  and  Campbell,  1 979,  p.  3 1 1 ). 

38  A  limitation  of  cross- lagged  panel  analysis  is  that  it  looks  at  the  relationship  between  a 
predictor  and  outcome  variable  in  "either-or"  terms.  The  assumption  of  absolute  independence 
between  the  two  variables  is  rarely  met  in  social  variables  where  there  often  is  a  significant 
amount  of  interdependence  and  reciprocal  Influence. 

39  The  z  test  Is  also  reproduced  here  in  detail  due  to  the  difficulties  the  author  experienced  in 

Vn  (rp  -  rp) 

tracking  down  the  original  citation,  z  =  - r£2)2  +  ( j  rp2)2 — JT  where  N ’s  *he 

sample  size  and  k  is  a  constant: 


So  far  the  discussion  of  data  analysis  has  been  limited  to  the 
consideration  of  bivariate  relationships.  In  step  four  of  the  design,  the 
perspective  was  enlarged  to  include  multivariate  relationships  between 
sobriety,  as  an  outcome  variable,  and  the  test  and  control  variables.40 
Multiple  regression  was  used  to  address  the  question  of  the  relative 
contribution  of  the  test  variables  vis-a-vis  the  control  variables. 

The  independent  variables  consisted  of  either  continuous  data  or 
categorical  data  which  had  previously  been  collapsed  Into  dichotomies  to 
conform  to  the  multiple  regression  requirement  for  Interval  data41  The 
dependent  variable  was  measured  on  an  Interval  scale  (number  of  months  of 
sobriety  per  follow-up  period).  Multiple  regression  equations  were 
developed  within  each  time  period.  Six-month  outcome  variables  were 
compared  with  six-month  control  and  six-month  test  variables,  etc.  Trends 
evident  in  the  data  over  the  two-year  time  frame  of  this  study  were 
discussed  descriptively. 

As  described  in  an  earlier  chapter,  the  control  variables  chosen  for 
this  study  reflect  variables  which  have  been  previously  shown  to  explain  a 
portion  of  the  variance  in  the  outcome  variables.  The  first  step  (see 
Figure  4)  In  the  multiple  regression  analysis  was  to  assess  the  relative 
contribution  of  all  of  the  Independent  variables  to  an  explanation  of  the 
variance  In  sobriety  by  entering  them  into  a  multiple  regression  equation  in 

40  As  will  be  discussed  In  the  next  chapter ,  bivariate  analyses  between  the  test  variables  and 
outcome  variables  (see  Table  8)  yielded  only  two  statistically  significant  relationships  which 
were  consistent  across  the  two  year  time  frame  of  this  study:  AA  attendance  and  sobriety,  and 
aftercare  and  sobriety.  Consequently  sobriety  Is  the  only  outcome  variable  addressed  through 
multiple  regression  and  linear  discriminant  analyses  in  the  remaining  sections  of  this  chapter. 

4 1  As  noted  earlier ,  any  dichotomy  can  be  treated  as  though  It  were  an  interval  measure  ( Nie  et 
a!.,  1975,  p.  5). 
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a  stepwise  fashion,  without  Identifying  whether  they  were  test  or  control 
variables.  "The  order  of  Inclusion  was  determined  by  the  respective 
contribution  of  each  variable  to  explained  variance"  in  the  outcome  variable 
(Nie  et  al.,  1975,  p.  345).42The  second  step  (see  Figure  4)  of  the  multiple 
regression  analysis  involved  a  two  stage  process.  First,  all  of  the  control 
variables  meeting  the  minimum  levels  established  by  the  multiple 
regression  parameters  were  entered,  as  a  block,  Into  the  multiple 
regression  equation.  Second,  having  taken  into  account  the  control 
variables,  AA  attendance  as  a  test  variable  was  next  entered,  providing  it 
met  the  minimum  F  ratio  and  tolerance  levels  established  by  the  parameters 
of  the  program.  In  a  similar  fashion,  In  the 

third  step  (see  Figure  4),  the  control  variables  and  AA  attendance 
were  first  entered  as  a  block.  Next,  aftercare  was  added  to  see  if  it  added 
anything  to  the  explanation  of  the  outcome  variance  after  accounting  for 
both  the  control  variables  and  AA  attendance.43  The  F  ratio  test  was  used  to 


r. 


B 
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assess  whether  the  addition  of  the  test  variables  added  to  the  explanation 
of  the  variance  already  accounted  for  by  the  control  variables.  As  noted  In 
an  earlier  discussion,  the  tests  of  significance  were  used  for  comparisons 
within  the  study  sample  and  with  no  expectation  that  the  results  would  be 
generalized  beyond  the  sample. 


42  The  multiple  regression  analyses  used  SPSS  default  settings  for  the  parameters  of  the 
multiple  regression.  All  independent  variables  were  considered.  The  minimum  F  ratio  for 
Inclusion  was  0.01  and  the  minimum  tolerance  (proportion  of  the  variance  of  a  specific  variable 
under  consideration  not  explained  by  the  independent  variables  already  in  the  equation)  wss 
0.001.  ( Nie  et  al.,  1975,  p.  346). 

43  The  choice  of  entering  AA  attendance  first  was  based  on  the  results  of  the  bivariate  analyses. 
Adding  aftercare  second,  after  AA  attendance,  in  effect  controlled  for  the  problematic  interaction 
between  the  two  predictor  variables.  SPSS  conducted  step  two  and  step  three  at  the  same  time. 
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One  difficulty  in  an  ex  post  facto  analysis  of  a  large  body  of  data  is 
the  probability  of  making  a  Type  I  error,  i.e.,  that  in  a  sample  the  probability 
of  a  spurious  relationship  occurring  increases  (Bentler,  et  al.,  1976;  and 
Pedhazur,  1982).  This  issue  was  addressed  by  this  design  on  two  levels. 
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First,  a  conservative  critical  value  was  established  against  which  the  tests 
of  statistical  significance  were  compared.  Only  those  tests  which  produced 
a  critical  value  at  a  i  0.01  were  considered  to  be  significant. 

Second,  the  issue  of  the  increased  probability  of  spurious  outcome  in 
a  large  ex  post  facto  study  was  addressed  through  a  cross-validation  of  the 
multiple  regression  equations.  As  was  previously  discussed,  the  sample 
(N  ■  2,950)  was  divided  using  a  random  number  process  into  two 
subsamples  of  equivalent  size.44  If  significant  relationships  were 
demonstrated  In  both  samples,  one  could  conclude  that  the  results 
represented  a  substantiated  rather  than  spurious  relationship. 

The  multiple  regression  equations  developed  on  the  first  subsample 
were  used  to  predict  outcome  scores  (Y*)  for  the  second  subsample.  A 
“Pearson  r”  was  then  calculated  between  the  actual  outcome  scores  (Y)  of 
the  second  subsample  and  their  predicted  outcome  scores  (Y‘).  This  ryv  is 
analogous  to  a  multiple  correlation  for  the  second  subsample,  using  the  data 
from  the  second  sample  with  the  multiple  regression  equation  of  the  first 
subsample  (Pedhazur,  1982,  pp.  149-  150). 

The  multiple  regression  results  were  considered  to  be  cross- 
validated  when  there  was  a  reasonable  agreement  between  the  multiple 
correlation  coefficient  (R)  of  the  first  sample  and  the  Pearson  r  (ryv1)  of  the 
second  sample.45  The  multiple  regression  results  are  considered  to  be 


44  The  multiple  regression  equations  were  developed  on  a  subsample  with  an  N  =  1 ,435.  The 
results  of  the  multiple  regression  equations  were  subsequently  cross  validated  on  the  second 
subsample  with  an  N  *  1 ,55 1 . 

45  Pedhazur  ( 1 982)  notes  that  a  certain  amount  of  shrinkage  in  the  multiple  regression 
coefficients  Is  to  be  expected  when  one  compares  the  original  sample  R  with  the  cross- validated 
rw'  ( P-  1 49).  Or.  Michael  Luxenberg,  statistical  consultant  to  CATOR.in  a  personal  conversation 
noted  that  occasionally  the  cross-validated  ryy'  will  be  larger  than  the  original  sample  R.  The 
increase  Is  spurious,  and  as  long  as  the  two  coefficients  are  reasonably  equivalent,  the  multiple 


■vw’tvivr 


■.y.AAO.v.V.vvy.y 


spurious  when  there  Is  little  or  no  agreement  between  the  the  multiple 
correlation  coefficients.  Reasonable  agreement  between  the  multiple 
regression  coefficient  (R)  of  the  first  sample  and  the  cross-validated 
Pearson  r  (rYv)  of  the  second  sample  would  substantiate  a  model  explaining 
outcome  variance  through  the  addition  of  the  test  variables,  adding  to  our 
understanding,  over  and  above  the  outcome  variance  already  explained  by  the 
control  variables. 

The  final  step  of  the  design  used  linear  discriminant  analysis  to  look 
at  the  relative  effectiveness  of  the  model  (Figure  1 )  which  explained 
outcome  variance  in  terms  of  selected  control  variables  and  the  two  test 
variables  of  AA  attendance  and  aftercare  attendance.  One  measure  of  an 
effective  model  explaining  the  variance  In  the  outcome  variable  would  be  its 
ability  to  predict  Individuals'  outcome  scores  on  the  basis  of  their 
Independent  variable  scores. 

For  the  purpose  of  the  linear  discriminant  analysis,  the  study  sample 
was  divided  statistically  Into  two  groups  on  the  basis  of  their  outcome 
scores  ("sober"  and  "not  sober").46  A  discriminant  function  was  created  by 
"weighing  and  linearly  combining  the  Independent  variables  so  that  the  two 
groups,  measured  on  the  outcome  variable,  were  forced  to  be  as 
statistically  distinct  as  possible"  (Nie  et  al.,  1975,  p.  435).  As 
discriminating  variables,  the  control  variables  were  entered  as  a  block, 


regression  results  are  considered  to  be  validated.  Reasonable  agreement  is  a  subjective  decision 
which  has  been  enhanced  in  this  stud/  by  calculating  a  t-test  between  the  actual  and  predicted 
outcome  scores,  using  a  conservative  critical  value  i  0.0 1 . 

46  As  noted  earlier,  sobriety  was  the  only  outcome  variable  to  correlate  significantly  across 
time  with  the  test  variables. 


followed  by  the  two  test  variables  (AA  attendance  and  then  aftercare 
attendance). 
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The  statistical  significance  of  the  discriminant  analysis  was 
assessed  by  observing  the  resulting  eigenvalues  associated  with  the 
discriminant  functton  and  its  accompanying  canonical  correlations.47*48-  As 
a  final  step,  the  2,950  subjects  were  reclassified  by  the  discriminant 
function  into  either  sober  or  not  sober  groups.  The  percent  of  correct 
assignments  provided  an  estimate  of  the  model's  effectiveness  when  used  to 
predict  group  membership.  An  effective  model  would  correctly  assign 
subjects  to  the  appropriate  category  solely  on  the  basis  of  their 
discriminant  function  scores. 


47  "The  eigenvalue  Is  a  special  measure  computed  in  the  process  of  deriving  the  discriminant 
function.  It  Is  a  measure  of  the  relative  importance  of  the  function"  (Nleetal.,  1975,  p.  442). 
40  "The  canonical  correlation  Is  another  measure  of  the  discriminant  function’s  ability  to 
discriminate  among  groups.  The  canonical  correlation  squared  Is  Interpreted  as  the  proportion  of 
the  variance  in  the  discriminant  function  explained  by  the  groups"  ( Nie  at  al. ,  1 975.  p.  442). 


In  the  early  stages  of  the  data  analysis,  it  became  evident  that 
\  tercare"  as  a  test  variable  was  compromised  in  terms  of  construct 
validity  on  at  least  two  levels.  On  one  level,  it  appeared  that  formal 
aftercare  for  chemical  dependency  treatment  was  confounded  with  mental 
health  treatment.  In  the  manner  in  which  CATOR-lll  asked  the  question,  it 
was  possible  that  a  client  who  did  not  attend  aftercare  would  still  answer 
affirmatively  because  the  question  did  not  differentiate  mental  health 
treatment  from  aftercare  treatment. 

Confounding  mental  health  treatment  with  chemical  dependency 
aftercare  created  a  situation  which  would  potentially  bias  the  results  from 
at  least  two  directions.  The  first  biasing  factor  was  that  the  inflated 
aftercare  response  would  not  accurately  reflect  the  contribution  of  the 
variable  and,  further,  aftercare  might  have  received  credit  more 
appropriately  due  mental  health  Intervention.  The  second  biasing  factor  was 
that  mental  health  clients  with  alcohol  problems  have  a  poorer  prognosis 
than  alcoholic  clients  without  identified  mental  health  problems  (Schuckit, 
1983).  Including  these  clients  In  the  aftercare  attendance  group  by 
assuming  their  mental  health  treatment  was  equivalent  to  aftercare 
treatment  could  significantly  dilute  the  reported  efficacy  of  aftercare 
through  the  negative  impact  of  their  relatively  poorer  prognoses. 

This  problem  Is  an  example  of  a  problem  Inherent  In  secondary  data 
analysis.  It  was  not  possible  to  go  back  and  ask  subjects  to  clarify  their 
earlier  responses  by  differentiating  their  mental  health  treatment  from 


chemical  dependency  aftercare.  Even  if  It  were  possible  to  identify  a  subset 
of  clients  within  the  study  sample  who  had  mental  health  problems,  from 
the  existing  data  it  is  not  possible  to  separate  the  two  types  of  treatment. 

In  CATOR-IV  the  aftercare  questions  have  been  written  so  as  to  be  able  to 
discriminate  between  chemical  dependency  aftercare  and  mental  health 
treatment. 

Unlike  the  first  problem,  the  second  problem  with  construct  validity 
was  able  to  be  addressed  to  a  limited  degree  through  further  data  analysis. 
The  second  problem  developed  from  conceptualizing  "aftercare  attendance" 
as  either  being  present  or  absent.  Intuitively,  it  would  seem  that 
structuring  the  variable  as  a  dichotomy  would  not  capture  relevant  aspects 
of  the  variable,  within  the  constraints  Imposed  by  secondary  data  analysis, 
the  author  attempted  to  Improve  the  quality  of  the  construct  by  creating  an 
index  of  the  “Intensity  of  aftercare  services."  It  was  hoped  that  this  index 
would  provide  a  more  sensitive  measure  of  aftercare. 

A  small  sample  (N  =  15)  of  treatment  facilities  was  selected,  based 
on  the  facilities*  relative  contribution  to  the  overall  sample  size.  An 
interview  protocol  (See  Appendix  B)  was  developed  by  the  author  to  look  at  a 
number  of  program  elements  which  were  felt  to  be  relevant  to  a  discussion 
of  the  intensity  of  aftercare  services.48  Telephone  interviews  were 
conducted  with  the  15  aftercare  coordinators  selected  for  participation. 

Using  a  checklist  (See  Appendix  C)  developed  by  the  author,  the 
resulting  descriptive  Information  was  quantified.  A  three-  category  (high, 

48  A  list  of  program  elements  relevant  to  aftercare  was  generated  based  on  discussion  between 
the  author ,  CATOR  staff,  and  a  local  area  aftercare  coordinator  who  was  consulted  prior  to  the 
collection  of  the  additional  data. 


medium,  and  low)  Index  was  created,  using  a  cutting  score  which  divided  the 
sample  Into  roughly  three  equivalent  groups  (See  Appendix  D).  In  a  separate 
data  analysis,  selecting  from  the  study  sample  only  those  subjects  from  the 
interviewed  treatment  facilities,  a  number  of  the  bivariate  comparisons 
were  recomputed.49  Unfortunately,  the  resulting  data  analyses,  which  will 
be  described  In  the  next  chapter,  did  not  Improve  the  explanatory  power  of 
aftercare  as  a  predictor  variable  when  the  intensity  of  aftercare,  as  defined 
above,  was  taken  Into  consideration.50 

in  summary,  this  chapter  has  addressed  the  methodological  aspects  of 
this  study.  A  description  of  CATOR  and  Its  operational  procedures  was 
presented.  The  sampling  procedure  utilized  In  this  study  was  described  and 
the  study  sample  was  compared  with  the  population  from  which  It  was 
selected.  A  six-step  data  analysis  design  was  outlined.  The  rationale  for 
the  use  of  tests  of  statistical  significance  and  measures  of  association 
with  a  purposive  sample  was  delineated.  Finally,  a  problem  regarding  the 
validity  of  a  construct  was  Introduced  and  an  attempt  to  improve  the  quality 
of  the  construct  by  creating  an  Index  of  Intensity  of  aftercare  services  was 
described,  in  the  next  chapter,  the  results  of  the  data  analysis  will  be 
presented. 


49  Each  of  the  fifteen  treatment  centers  was  classified  as  providing  high  intensity,  medium 
Intensity,  or  low  Intensity  aftercare  services. 

50  Formal  assessment  of  the  validity  are!  reliability  of  the  index  was  beyond  the  scope  of  the 
present  study.  Informal  consensus  among  the  1 5  interviewed  aftercare  coordinators  was  that  the 
seven  elements  of  the  Interview  protocol  Identified  areas  which  they  felt  to  be  particularly 
relevant  to  the  operation  of  their  aftercare  programs. 


Chapter  five  reports  the  results  of  the  secondary  data  analysis  design 
described  in  the  last  chapter.  The  complex  set  of  data  generated  by  the 
research  design  has  been  divided  into  four  sections  to  facilitate  its 
presentation.  The  first  section  describes  selected  demographic 
characteristics  of  the  study  sample.  Through  a  series  of  bivariate 
comparisons,  the  second  section  of  this  chapter  focuses  the  data  analysis  by 
first,  clarifying  the  marginal  contributions  of  the  control  variables,  and 
second,  reducing  the  number  of  outcome  variables  to  be  examined  in  the 
remainder  of  this  chapter. 

The  third  section  makes  use  of  cross-lagged  panel  analysis  to  further 
explicate  the  relationships  between  the  two  test  variables  and  sobriety,  the 
one  dependent  variable  for  which  significant  relationships  across  time 
could  be  demonstrated.  The  final  section  of  this  chapter  begins  with  a 
multivariate  description  of  the  relationships  between  sobriety  and  the 
control  and  test  variables  and,  concludes  with  an  assessment  of  the  relative 
importance  these  findings  vis-a-vis  predictive  utility. 

Each  of  the  sections  begins  with  a  brief  synopsis  of  the  findings 
which  will  then  be  discussed  In  some  detail.  The  goal  of  this  chapter  is 
limited  to  the  presentation  of  the  data  and  a  description  of  the 
relationships  observed  among  the  variables.  For  the  most  part, 
Interpretation  of  the  data  will  be  reserved  for  the  next  chapter. 


Tables  9  through  Table  16  describe  characteristics  of  the  sample  In 
terms  of  the  variables  selected  for  study.  The  adequacy  of  CATOR’s  data 
management  procedures  were  confirmed  by  this  univariate  analysis  as  no 
obvious  problems  were  noted  with  the  data.  A  review  of  the  frequency 

Table  9:  Age  Distribution  of  Study  Sample 


Age  Category 


distributions  detected  neither  questionable  values  nor  inappropriate 
categories.  Except  as  specifically  noted  in  the  discussion  below,  subjects 
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tended  to  be  distributed  in  a  roughly  symmetric,  unimodal  fashion  across  i 

the  variables.  There  were  no  extreme  distributions. 

Table  10:  Years  of  Education  of  Study  Sample 


2000  -i 


0-8  yrs  9-12  yrs  13-16  yrs  17-24  yrs 

Years  of  Education 


The  sample  reflected  a  broad  spectrum  of  subjects,  drawn  from  the 
Midwestern  United  States.  Male  subjects  outnumbered  female  subjects.  The 
sample  was  skewed  somewhat  towards  younger  adults  who  were 
predominantly  white  and  frequently  involved  In  a  relationship  with  a 
significant  other.  The  majority  of  subjects  had  at  least  a  high  school 
diploma  and  were  employed  at  the  time  of  their  admission  into  chemical 
dependency  inpatient  treatment.  While  this  admission  was  the  first 
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admission  for  most  of  the  subjects,  alcohol  problems  mixed  with  drug 
abuse  were  reported  by  a  substantial  proportion  of  the  sample. 

Table  9  shows  that  the  subjects  ranged  in  age  from  16  years  to  80 
years.  The  mean  age  was  38.9  years  with  a  standard  deviation  of  14.06 
years.  The  median  age  was  37.0  years,  Indicating  that  on  the  age  variable 
the  subjects  were  skewed  somewhat  to  the  left,  concentrated  in  the  mid- 
20s  to  1ate-30s.  This  finding  Is  consistent  with  other  studies  which  report 
that  persons  with  alcohol  problems  tend  not  to  be  normally  distributed,  but 
rather,  clustered  around  the  categories  of  young  to  middle  aged  adults 
(Mendelson  andMello,  1985;  Bowen,  1987). 


White  Other 

Ethnic  Group 


The  level  of  education  ranged  the  entire  spectrum  from  two 
Individuals  with  no  formal  education  to  three  Individuals  with  Ph.D  level 
degrees  (see  Table  10).  The  mean  level  of  education  was  12.7  years  with  a 
standard  deviation  of  2.6  years.  This  variable  appeared  to  be  distributed  in 
a  normal  fashion  around  a  modal  level  of  12  years  education.  20%  of  the 
sample  had  less  than  a  high  school  education,  while  15%  of  the  sample  had 
at  least  four  years  of  college  education.1 


As  a  group,  whites  (95.3%)  are  overrepresented  in  this  study  while 
other  ethnic  groups  (47%)  are  underrepresented  (see  Table  1 1 ).  While  the 
treatment  centers  were  located  in  12  states,  61%  of  the  subjects  reported 
their  state  of  residence  as  being  Minnesota,  Wisconsin,  or  Iowa.  Hoffmann 
et  al.  (1985)  noted  that  the  proportion  of  whites  in  the  Minneapolis-St.  Paul, 
Minnesota- Wisconsin,  standard  metropolitan  statistical  area  was  95% 

(p.  1 8).  Parenthetically,  Westermeyer  ( 1 986)  noted  that  ethnicity,  as  an 
issue,  was  most  evident  in  terms  of  differential  access  of  minority  groups 
to  treatment  (p.  235).2 

2  Amaro,  Beckman ,  and  Mays  ( 1 987)  reported  that  "the  lack  of  third  party  coverage  for 
alcoholism  treatment  together  with  significantly  lower  financial  resources  for  Black  women 
severely  restricted  their  treatment  options  and  virtually  excluded  them  from  more  personalized 
treatment  programs"  (p.  227). 


it 


Mode  -  Employable 
Missing  Cases  »  17 


Employable  Not  Employable 

Employment  Category 


1 


Table  12  shows  that  28.8%  of  the  subjects  in  this  study  were  female, 
a  higher  percentage  than  has  been  reported  in  many  other  studies.  Beckman 
and  Amaro  (1985)  reported  that  it  is  estimated  that  fewer  than  20%  of  all 
clients  in  alcoholism  treatment  are  female  (p.  15).3  In  this  sample  males 
outnumbered  females  in  a  ratio  of  2.5  to  1 .  Beckman  and  Amaro  hypothesize 
that  this  difference  is  probably  more  reflective  of  a  difference  in 
utilization  of  services  rather  than  being  indicative  of  a  substantive 
difference  in  prevalence  rates  of  alcohol  problems  between  the  sexes. 


3  Quoting  Vanicelll ,  Harrison  and  Belllle  ( 1 987 )  noted  that  "women  still  accounted  for  only  a 
very  small  proportion  ( 8%)  of  research  subjects  in  treatment  outcome  studies  (p,  574). 


57.4%  of  the  sample  are  either  married  or  living  together  (see  Table 
13).  As  a  comparison,  only  46%  of  the  larger  CATOR-1 1 1  Inpatient  population 
described  themselves  as  married  or  living  together.  22,9%  of  the  sample 


Alcohol  Only  Drug  &  Alcohol  Drug  Only 

Type  of  Substance 


report  themselves  as  single  and  15.5%  report  their  status  as  separated  or 
divorced.  Only  3.3%  described  themselves  as  widowed,  which  was 
consistent  with  the  age  distribution  being  skewed  to  the  left.  Access  to 
supportive  relationships  (including  family  support)  was  one  of  the  variables 
which  differentiated  successful  outcome  in  a  number  of  the  studies 
reported  in  the  literature  review. 


(67.7X) 


Mode  -  0  previous  CD  TX  Admissions 


Missing  Cases  -81 


(20  .OX) 


(5.2X) 


(2.2X)  (2.1  X) 


0  1  2  3  4-  22 

Previous  CO  TX  Admissions 


Employment  was  another  variable  reported  in  the  literature  which 


appeared  to  differentiate  successful  outcome.  In  an  effort  to  more 


accurately  describe  employment  outcomes,  "employability",  as  an 
independent  variable,  was  created  to  reflect  the  quality  of  being  eligible  for 
employment  or  available  for  employment.  Persons  who  would  not  normally 
be  counted  In  employment  statistics  have  been  deleted  from  the  employable 
category.  Table  14  shows  that  80.7%  of  the  study  sample  were  considered 
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to  be  employable.4  1 9.3%  of  the  sample  described  themselves  as  retired, 
disabled,  homemakers,  or  students,  and  were  considered  unemployable.5 

From  Table  15,  the  relevance  of  the  issue  of  multiple  substance  abuse 
for  alcoholic  clients  is  clearly  evident.  While  45.6%  of  the  sample  reported 
having  problems  with  alcohol  only,  and  specifically  denied  abuse  of  other 
drugs,  44.3%  of  the  sample  reported  mixing  alcohol  problems  with  other 
substance  abuse.  7.2%  of  the  sample  reported  only  drug  abuse  without 
alcohol  problems.  Conceptually  dichotomizing  chemical  dependency  into 
either  drug  abuse  or  alcoholism  would  appear  to  seriously  understate 
chemical  abuse  issues  reported  by  a  sizeable  portion  of  this  sample. 

67.7%  of  the  study  sample  reported  no  previous  treatment  for 
chemical  dependency  problems  (see  Table  16).  20.0%  of  the  sample  had  been 
hospitalized  for  previous  treatment  on  no  more  than  two  occasions.  5.2%  of 
the  sample  were  hospitalized  for  three  or  more  admissions.  As  an  extreme 
outlier,  one  person  in  the  sample  had  been  hospitalized  22  times  for 
chemical  dependency  treatment.  For  the  majority  of  the  sample,  a 
"revolving  door"  pattern  of  multiple  treatment  episodes  could  not  be 
demonstrated. 


i 
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4  82.7*  ( 1 ,969)of  the  2,380  employable  subjects  were,  in  fact,  employed.  1 7.3*  (411 )  of 
the  employable  subjects  were  unemployed  at  the  point  they  entered  treatment. 

5  55.3*  ( 268)  of  the  553  unemployable  subjects  were  retired/  disabled.  32.4*  ( 1 79)  were 
homemakers  and  12.3*  ( 106)  were  students. 


The  relationships  among  the  two  test  variables,  eleven  outcome 
variables  and  eight  control  variables  were  explored  using  contingency  tables 
and  one-way  analyses  of  variance.  The  purpose  of  approaching  the  data  in 
this  fashion  was  to  gain  some  Independent  understanding  of  the  importance 
of  the  three  categories  of  variables  prior  to  looking  at  their  covariation  in 
the  multivariate  analyses.  As  will  be  discussed  in  the  next  chapter,  this 
sep arat)on  of  variables  Into  test,  control  and  outcome  categories, 
heurlstlcally  served  to  clarify  hypotheses  regarding  the  relationships  among 
the  variables. 

The  bivariate  analyses  proceed  In  a  logical  fashion.  The  initial  step 
looked  at  the  relationship  between  AA  attendance  and  aftercare  over  the 
two  year  time  frame  of  this  study,  in  the  next  step,  the  relationships 
between  the  two  test  variables  and  eight  control  variables  were  described. 
The  third  step  looked  at  the  relationship  between  the  two  test  variables  and 
the  outcome  variables.  The  final  step  of  the  bivariate  analyses  examined 
the  relationship  between  the  eight  control  variables  and  the  only  outcome 
variable  (sobriety)  for  which  significant  relationships  with  the  test 
variables  could  be  demonstrated. 


In  this  section  the  relationship  between  AA  attendance  and  aftercare 
was  explored  In  Tables  17  through  Table  22.  AA  attendance  was  reported  by 
a  substantial  number  of  subjects  across  the  time  frame  of  this  study,  in 
contrast,  a  much  smaller  group  of  subjects  reported  aftercare  attendance, 
and  for  the  most  part, this  attendance  appeared  to  be  limited  to  the  first 
year  of  follow-up.  A  surprisingly  large  group  of  subjects  reported  not 
attending  either  AA  or  aftercare. 

Table  12:  AA  Attendance  by  Time 


-o-  Don't  Attend 
Once/Month 
♦  Several/Month 
•o-  Weekly 


0 


6  months  12  months  18  months  24  months 

Time  Period 


AA  attendance  was  observed  to  be  more  stable  than  aftercare 
attendance  as  fewer  subjects  moved  In  and  out  of  the  AA  attendance 
category,  and  hence,  reported  a  higher  rate  of  cumulative  attendance.  The 
data  supported  the  argument  that,  for  this  sample,  there  was  considerable 
interaction  between  AA  attendance  and  aftercare.  AA  attendance  appeared 
to  reinforce  aftercare  attendance,  while  the  reverse  could  not  be 
demonstrated. 


Table  18:  AA  Attendance  (Dichotomized)  by  Time 


70  i 


•0-  Regular  Attend 
Don't  Attend 


30 


6  months  12  months  18  months  2A  months 

Tim*  Period 


AA  attendance  was  not  static  over  time.  As  can  be  seen  In  Table  1 7, 
there  were  three  distinct  attendance  patterns.  In  the  first  pattern,  a  large 
group  of  subjects  attended  AA  on  a  weekly  basis.  This  group  decreased  ih 


Table  19:  Aftercare  Attendance  by  Tinned6 7 


Tim*  Period 


Don't  Attend 
Attend 


i 

P 

P 


6  Unlike  the  manner  In  which  CAT  OR  categorized  the  AA  question,  the  aftercare  question  asked 
subjects  to  report  whether  the/  attended  aftercare,  did  not  attend  aftercare,  or  completed 

\  aftercare.  As  only  one  answer  was  allowed  for  the  question ,  "yes"  responses  and  “completed” 

)  responses  were  combined  Into  one  category.  The  relative  number  of  "completed"  responses  was 

<  very  small  for  all  four  time  periods  ( 94-  42-  37-  32).  The  expectation  of  the  aftercare 

5  program  coordinators  Interviewed  by  the  author  was  that  clients  would  attend  aftercare  groups  on 

■f  a  weekly  basis.  Distinguishing  regular  aftercare  attendance  from  occasional  or  sporadic  aftercare 

attendance  would  have  been  more  desirable, 

7  Noel ,  McCrady,  Stout,  and  Fisher-Nelson  ( 1 987)  reported  that  “refusing  treatment  or 
dropping  out  before  completion  was  the  norm"  In  an  outpatient  alcoholism  counseling  program  ( p. 
229). 


size  from  57.7%  to  41 . 1  %  of  the  sample  over  the  two-year  time  frame  of 
this  study.  In  the  second  pattern,  a  large  group  of  subjects  did  not  attend 
AA  at  all.  This  group  increased  In  size  from  28. 1%  to  44.3%  of  the  sample 
over  the  two-year  period.  The  third  pattern  is  demonstrated  by  a  small 
group  of  subjects  who  reported  attending  AA  on  a  sporadic  or  occasional 
basis.  This  pattern  remained  fairly  constant  across  the  two-year  time 
period. 

Table  20:  Crosstabulation  of  AA  and  Aftercare,  by  Time 


■  Both  AA  +  AC 
H  AAonly 
H  AC  only 
0  NO  AA  or  AC 


Tim*  Period 


The  two  patterns  of  either  attending  AA  on  a  weekly  basis  or  not  at 
all  accounted  for  the  majority  (approximately  85%)  of  the  subjects' 


responses .  The  four  categories  of  AA  attendance,  depicted  in  Table  1 7, 
were  subsequently  collapsed  to  create  a  dichotomous  variable  which 
contrasted  AA  attenders  with  non-attenders  (see  Table  18).  The  AA 
attendance  categories  were  collapsed  to  allow  for  the  multivariate  analysis 
which  follows,  as  well  as  to  permit  a  more  Intuitive  interpretation  of  the 
remaining  comparisons. 

Collapsing  the  categories  was  accomplished  by  dividing  the  effect  of 
the  relatively  small  percentage  of  the  sample  who  attended  on  a  sporadic 
basis.  Subjects  who  attended  one  time  per  month  were  assigned  to  the 
category  of  subjects  not  attending  AA.  Subjects  who  attended  AA  several 
times  a  month  were  reclassified  as  AA  attenders.  Slightly  more  sporadic 
attenders  were  reclassified  as  not  attending  AA  than  sporadic  attenders 
who  were  reclassified  as  AA  attenders. 

Table  1 9  shows  that  a  majority  of  the  subjects  In  this  sample  did  not 
attend  formal  aftercare  programs.  Despite  having  formal  programs  with 
professional  staff  assigned  to  expedite  the  transition  from  inpatient 
treatment,  only  43.1  percent  of  the  subjects  attended  aftercare  during  the 
first  6-month  time  period  following  discharge  from  treatment.  At  the  one- 
year  point,  only  26.3%  of  the  clients  were  still  attending  aftercare 
programs.  The  drop-out  rate  slowed  down  during  the  second  year  of  follow¬ 
up.  Subjects  still  attending  aftercare  beyond  12  months  remained,  for  the 
most  part,  In  aftercare  during  the  second  year.0 

8  As  noted  in  the  last  chapter ,  aftercare  and  mental  health  treatment  were  not  differentiated  in 
the  CATOR- 1 1 1  data.  One  hypothesis  to  consider  is  that  most  clients  discontinued  aftercare  during 
their  first  year  of  follow-up.  Clients  who  In  the  CATOR-III  data  pool,  continued  to  report 
attending  aftercare  during  the  second  follow-up  year ,  were  for  the  most  part,  reporting  attendance 
In  outpailent  mental  health  services.  Due  to  the  lack  of  differentiation  in  question  design,  In 
CATOR-III  aftercare  and  outpatient  mental  health  treatment  were  confounded.  CATOR-IV  has  been 
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Table  20  describes  the  crosstabulatlon  of  AA  attendance  with 
aftercare  attendance  over  time.  During  the  first  six-month  Interval,  72.9% 
of  the  sample  attended  either  AA ,  aftercare,  or  both  activities.  The  number 
of  subjects  who  reported  attending  some  type  of  supportive  service  declined 
gradually  over  time.  At  the  24-month  follow-up  interview,  52.9%  of  the 
subjects  still  reported  attending  some  type  of  supportive  service. 


redesigned  so  as  to  be  able  to  assess  the  relative  effects  of  aftercare  and  outpatient  mental  health 
treatment. 

9  AA  attendance  figures  were  calculated  on  a  N  *  2 ,9 1 2  due  to  38  missing  cases.  There  were  no 
missing  cases  for  aftercare  attendance  which  used  an  N  *  2 ,950. 

10  (cumulative  attendance  carried  over  from  prior  6  months) 

Percent  cumulative  attendance  =  ( concurrent  attendance  of  present  6  months) 
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It  appears  that  subjects  who  attended  either  AA  only,  or  aftercare 
only  remained  fairly  constant  over  the  two-year  ttme  period,  showing  only  a 
small  change  In  attendance  rates  from  6  months  to  24  months.  The  largest 
change  In  attendance  rates  occurred  In  the  group  which  reported  attending 
both  AA  and  aftercare  services.  This  group  decreased  In  size  from  34.7%  of 
the  sample  at  6  months  to  1 2.7%  of  the  sample  at  24  months.  At  the  same 
time,  the  group  which  reported  attending  neither  supportive  service 
Increased  from  27. 1%  of  the  sample  at  6  months  to  47.4%  of  the  sample  at 
24  months. 


6  months  12  Months  18  months  24  months 


Time  Period 


Table  21  examines  movement  between  attendance  categories  for  both 
AA  attendance  and  aftercare  attendance.  Cumulative  attendance  carries 
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with  It  a  connotation  of  stability.  One  Indicator  of  the  amount  of  stable 
attendance  Is  to  compare  the  cumulative  attendance  carried  forward  from 
the  previous  time  period  as  a  percent  of  the  total  concurrent  attendance  for 
a  given  time  period.  When  the  amount  of  cumulative  attendance  carried  over 
from  one  time  period  to  the  next  Is  relatively  low  when  compared  with  the 
concurrent  attendance,  It  Indicates  that  there  has  been  substantial 
movement  between  attendance  categories  from  one  time  period  to  the  next 
time  period.  When  the  amount  of  cumulative  attendance  is  relatively  high 
when  compared  with  the  concurrent  attendance  of  the  next  time  interval, 
the  attendance  can  be  considered  to  be  stable,  exhibiting  little  movement  in 
or  out  of  the  attendance  categories. 

At  the  first  follow-up  Interview,  there  were  no  differences  for  either 
A  A  attendance  or  aftercare  attendance  as  the  concurrent  attendance  levels 
were  equivalent  to  the  cumulative  attendance  levels  at  that  point. 

Beginning  with  the  second  follow-up  Interval,  however,  It  was  apparent  that 
AA  attendance  was  more  stable  when  compared  with  aftercare  attendance. 
Table  21  shows  that  the  rate  of  decline  in  the  percent  of  cumulative 
attendance  figures  for  AA  attendance  slowed  In  the  second  year.  Aftercare 
attendance  continued  to  show  substantial  decreases  in  the  percent  of 
cumulative  attendance  for  each  follow-up  period  for  both  years. 

One  measure  of  the  relative  influence  of  AA  attendance  on  aftercare 
attendance  can  be  seen  In  Table  22.  The  percent  of  AA  attenders  who  also 
attended  aftercare  dropped  off  significantly  at  each  follow-up  Interview,  in 
contrast,  subjects  who  attended  aftercare,  also  tended  to  maintain 
relatively  high  levels  of  AA  attendance.  The  AA  attendance  rates  of 
aftercare  attenders  remained  fairly  constant  across  the  four  follow-up 


V.’AV.V.W.V.W.V 


v.v.v.y.v.v.. 


"TLWVTV  TUT^T 


23 

ad 

1 


i 

i 


< 


h 

> 

i 

\ 

\ 

\ 


6  months  12  Months  16  Months  24  Months 


Control  Variables 


1.  Age 

n.a. 

n.a. 

n.a. 

n.a. 

2.  Gender 

n.a. 

n.a. 

n.a. 

n.a. 

3.  Marital  Status 

n.a. 

n.a. 

n.a. 

n.a. 

4.  Ethnicity 

n.a. 

n.a. 

0 

n.a. 

5.  Employability 

0 

n.a. 

n.a. 

n.a. 

6.  Previous  CD  Treatment 

0 

0 

0 

n.a. 

7.  Type  of  Substance 

n,a. 

n.a. 

n.a. 

n.a. 

8.  Education 

n.a. 

♦ 

+ 

+ 

( n.a.  =  X2  not  significant  at  0.0 1 ) 

(0  -X2  significant  i  0.01 ,  but  f  or  Cramer's  V  <  0.10)12-13 
( +  =  positive  relationship  with  X2  significant  i  0.0 1 ,  and  *  or 
Cramer's  Vi  0.10) 

( -  =  negative  relationship  with  X2  significant  i  0.0 1 ,  and  t  or 
Cramer's  Vi  0.10) 


1 1  See  Appendix  E- 1  for  the  specific  data  which  are  summarized  in  this  table. 

12  Cramer's  Vis  considered  to  be  a  "slightly  modified  version"  of  ♦  (Nieetal.,  1975, 

p.  224).Cohen(  1969),  quoted  in  Howell,  1982  .describes  a  small  effect  as*  -.tO.amedtum 
effect  *  *.25,  and  a  large  effect  f  » .40. 

13  In  large  data  sets,  the  greater  the  N,  the  less  the  difference  between  the  two  variables  is 
required  to  reach  statistical  significance.  Consequently  In  a  sample  of  this  size  ( N  =  2 ,950) ,  It  is 
possible  to  obtain  a  significant  Chi  Square  Test  between  two  variables,  when  in  fact,  the 
proportional  difference  between  the  two  variables,  as  reported  by  t  or  Cramer's  V  is  very  small. 

( Paraphrase  of  a  conversation  between  the  author  and  Dr.  Norman  G.  Hoffmann ,  Spring  Quarter , 
1988). 


Control  Variables 

6  months 

12  Months 

lauoolte 

24  Months 

1.  Age 

n.a. 

n.a. 

n.a. 

n.a. 

2.  Gender 

+a 

+a 

+a 

♦a 

3.  Marital  Status 

0 

n.a. 

n.a. 

n.a. 

4.  Ethnicity 

n.a. 

n.a. 

n.a. 

n.a. 

5.  Employability 

0 

n.a. 

n.a. 

n.a. 

6.  Previous  CD  Treatment 

n.a. 

n.a. 

n.a. 

n.a. 

7.  Type  of  Substance 

0 

0 

0 

+b 

8.  Education 

n.a. 

n.a. 

+ 

+ 

(a  Ma1e  =  0,  Female  *  1) 

(b  alcohol  only  ■  0.  mixed  drugs  and  alcohol  =  1 ,  drugs  only  =  2) 
( n.a.  *  X2  not  significant  at  0.0 1 ) 

( 0  *  X2  significant  i  0.0 1 ,  but  #  or  Cramer's  V  <  0. 1 0) 

( +  *  positive  relationship  with  X2  significant  i  0.01 ,  and  *  or 
Cramer's  Vi  0.10) 

( -  =  negative  relationship  with  X2  significant  s  0.01,  and*  or 
Cramer’s  Vi  0.10) 


This  section  begins  with  two  summary  tables  (Tables  23  and  ; 

Table  24)  which  suggest  that,  for  this  sample,  there  was  very  little 
Interaction  between  the  control  variables  and  either  AA  attendance  or 
aftercare.  Tables  25  through  Table  30  examine  In  detail  the  relationships  j 

between  the  two  test  variables  and  the  control  variables  for  which  I 

statistically  significant  relationships  with  acceptable  measures  of  ! 


14  See  Appendix  E-2  for  the  specific  data  which  are  summarized  In  this  table. 
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association  could  be  identified.15-16*17  Tables  25  through  Table  30 
graphically  depict  2X2  contingency  tables.  All  cells  are  presented  in  order 
to  underscore  the  point  that  the  difference  in  the  test  variable  categories 
accounted  for  a  substantially  larger  portion  of  the  relationship  than  did  the 
difference  In  the  control  variable  categories. 

Overall,  Table  23  and  Table  24  show  that  the  relationships  between 
the  control  variables  and  the  two  test  variables  were  generally  fairly  weak. 
This  suggests  that,  for  the  most  part,  there  was  relatively  little  Interaction 
between  the  control  variables  and  either  aftercare  or  AA  attendance.  Age 
did  not  differentiate  attendance  for  either  AA  or  aftercare.  Level  of 
education  was  the  only  control  variable  which  demonstrated  a  significant 
relationship  with  both  test  variables  across  time.  The  remaining  control 
variables  appeared  to  have  a  differential  effect,  depending  on  which  test 
variable  was  being  discussed. 


15  As  will  be  discussed  later  In  this  chapter ,  an  identified  relationship  between  two  variables 
had  to  be  both  statistically  significant  and  explain  a  measurable  portion  of  the  variance  in  the 
dependent  variable,  for  the  relationship  to  be  considered  important. 


Cramer's  V  can  be  interpreted  as: 


♦  - 


,  where  L  is  either  the  number  of  rows  or  columns, 


which  ever  is  less. 

16  Describing  the  magnitude  of  association  in  nominal  data  can  be  problematic.  While  a  2X2 
contingency  table  produces  a  t ,  where  the  t2  is  comparable  In  meaning  to  R2,  for  larger 
contingency  tables  It  Is  difficult  to  come  up  with  a  meaningful  measure  of  the  magnitude  of 
association  (Hays,  1981 ,  pp.  555-  559). 

17  For  nominal  data,  It  Is  not  possible  to  determine  from  the  magnitude  of  association  measure 
where  the  significance  of  the  relationship  between  a  large  number  of  categories  lies,  only  that  a 
relationship  is  present  within  the  data.  While  the  relationships  will  be  described  descriptively, 
for  the  sake  of  discussion  with  the  later  ANOYA  summary  tables,  (Table  3 1  and  Table  32),  a  chi 
square  must  also  produce  at  or  a  Cramer's  V  of  at  least  0. 1 0  to  be  considered  to  reflect  an 
important  relationship,  as  opposed  to  possibly  being  a  spurious  relationship  due  to  the  large 
sample  size. 
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40  A 


-Q-  Male-  Yes 
-o-  Male-  No 
-*■  Female- Yes 
Female- No 


30  J - 1 - 1 - 1 - 1 - 

6  months  12  months  18  months  24  months 


TIim  Period 


(06  months)  x2  (3  df)  =  6.98  (N$) 
(12  months)  x2  (3  Of)  -  4.84  (NS) 
(18  months)  x2  (3  df)  -  5.24  (NS) 
(24  months)  x2  (3  df)  =  5.85  (NS) 

Critical  value  with  3  df:  1 1 .34 


Cramer's  V  =  0.049 
Cramer's  V  =  0.040 
Cramer's  V  =  0.042 
Cramer's  V  =  0.045 


Three  varlables(  marital  status,  ethnicity,  and  employability)  listed 
In  Tables  23  and  Table  24  demonstrated  very  weak  relationships  with  the 
test  variables.  Although  producing  statistically  significant  Chi  Square 
Tests,  there  was  so  little  association  between  the  test  variables  and  the 
three  control  variables  as  to  make  Interpretation  of  the  relationships 
meaningless.  For  this  reason,  the  Individual  relationships  are  not  presented 
graphically.  The  specific  data  can  be  found  in  Appendices  E-1  and  E-2.1® 


,8  Marital  status  only  correlated  with  aftercare  in  the  first  follow-up  interval ,  and  did  not 
correlate  at  all  with  AA  attendance.  Ethnicity  was  correlated  with  AA  attendance  in  the  third 
follow-up  Interval  only,  and  did  not  correlate  at  all  with  aftercare.  In  a  similar  fashion 


6  months  12  months  18  months  24  months 

Tim*  Period 


(06  months)  x2  (2df)  -  11.2*. 

( 1 2  months)  ( 2  df)  -  35.36 
(18  months)  x2  (2  df)  -  30.87 
(24  months)  x2  (2df)  *  32.76 

Critical  value  with  2  df:  0.01=9.21 


o  Male-  Yes 
-o-  Male-  No 
♦  Female-  Yes 
Female- No 


Cramer’s  V  =  0.062 
Cramer’s  V  =  0.1 10 
Cramer's  V  =  0. 1 02 
Cramer's  V  =  0.106 


The  relationship  between  the  subjects'  gender  and  both  test  variables 
was  intriguing  (see  Tables  25  and  26).  As  was  described  In  an  earlier 
section  of  this  study,  it  was  expected  that  subjects'  gender  and  AA 
attendance  would  show  a  significant  correlation  with  significantly  fewer 
women  attending  AA.  This,  however,  was  not  the  case.  In  this  sample, 
subjects'  gender  (Table  25)  did  not  correlate  with  AA  attendance  at  any 


employability  was  statistically  significant  for  both  aftercare  and M  attendance  only  in  the  first 
follow-up  period. 
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point  in  time.  What  Is  particularly  interesting  to  note  in  Table  25,  was  that 
the  women,  rather  than  not  attending  AA,  had  rates  which  were  consistently 
above  the  males,  even  though  the  difference  was  not  statistically 


6  months  12  months  18  months  24  months 

Time  Period 


( 06  months)  X2  (39  df)  =  68.75  Cramer’s  V  =  0.090 

( 1 2  months)  X2  ( 39  df)  =  63.06  Cramer's  V  =  0.085 

( 1 8  months)  X2  ( 39  df )  =  62.70  Cramer's  V  =  0.085 

(24  months)  X2  (39  df)  =  59.78  (NS)  Cramer's V  =  0.083 

Critical  Yalue  with  39  df:  0.0 1  =  62. 1 0 

significant.  This  pattern  Is  even  more  clearly  evident  In  the  relationship 
between  subjects'  gender  and  aftercare  attendance  (see  Table  26).  In  this 
case,  the  difference  Is  statistically  significant  at  a  =  0.01  for  all  four 
follow-up  Intervals.  It  should  be  noted,  however,  that  the  relative  size  of 
the  measure  association  Is  small  Indicating  only  a  small  degree  of 
association  between  aftercare  attendance  and  gender. 


»A* 


t  H.i 


Comparing  the  graphs  In  Tables  25  and  Table  26  it  was  evident  that 
both  men  and  women  reported  significantly  higher  AA  attendance  rates  than 
aftercare  attendance  rates.  For  aftercare,  both  men  and  women  demonstrate 
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20 

Alcohol  Yes 
-o-  Alcohol  No 
■*  Drugs  Yes 
Drugs  No 
D  &  A  Yes 
D  8»  A  No 


6  months  12  months  18  months  24  months 

Time  Period 


(06  months)  x2  (2  df)  *  20,69 
(12  months)  x2  ( 2  df )  ■  22.0? 
(18 months)  x2 (2df)  =  23.19 
(24  months)  x2  (2df)  *  27.87 


Cramer's  V  =  0.08 
Cramer's  V  =  0.09 
Cramer's  V  =  0.09 
Cramer’s  V  =  0. 1 0 


Critical  value  with  2  df:  0.001  =  13.82 


a  steady  decline  In  attendance  across  the  two  year  time  frame.  The  rate  of 
decline  for  AA  attendance  appeared  to  slow  down  in  the  second  year. 
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-Q-  0-12  Yr  Yes 
0-12  Yr  No 
♦  13-24  Yr  Yes 
-o-  13-24  No 


6  months  12  months  18  months  24  months 

T!im  Period 


( 06  months)  X2  ( 24  <Jf )  =  35. 1 3  ( NS) 
(12  months)  X2  (24 df)  =  60.15 
(18  months)  X2  ( 24  df)  -  49.08 
(24  months)  X2  (24  df)  =  52.35 

Critical  value  with  24  df:  0.01  =42.98 


Cramer's  V  =  0.1 12 
Cramer's  V  =  0. 1 47 
Cramer's  V  =  0. 1 33 
Cramer's  V  =  0. 1 37 


Previous  admissions  for  chemical  dependency  treatment  did  not 
correlate  with  aftercare  attendance,  but  were  correlated  with  AA 
attendance  in  three  of  the  four  follow-up  periods  (see  Table  27).  As  a 
dichotomous  variable,  reporting  any  previous  admissions  was  significantly 
correlated  with  regular  AA  attendance,  For  both  categories  of  the  variable, 
the  same  general  decline  In  the  relative  percentage  of  the  sample  attending 
AA  was  noted  over  the  two  year  time  frame.  The  Cramer’s  V  statistics 
indicated  that,  while  the  relationship  was  statistically  significant,  there 
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was  little  association  between  previous  admissions  for  chemical 
dependency  treatment  and  AA  attendance. 
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6  months  12  months  18  months  24  months 

Tim#  Period 


-0-  0-12  Yr  Yes 
0-12  Yr  No 
13-24  Yr  Yes 
13-24  Yr  No 


(06  months)  X2  (24  df)  *  32.04  (NS) 
(12  months)  x2  (24df)  =  42.19  (NS) 
(18  months)  x2  ( 24  df)  =  45.57 
(24  months)  x2  (24  df)  =  48.44 

Critical  value  with  24  df:  0.0 1  *  42.98 


Cramer’s  V  =  0.107 
Cramer’s  V  =  0. 1 23 
Cramer's  V  =  0.128 
Cramer’s  V  =  0.132 


The  type  of  substance  abuse  correlated  with  aftercare  attendance  but 
not  AA  attendance  (see  Table  28).  Subjects  who  reported  "drug  abuse  only" 
had  the  highest  aftercare  attendance  rates,  while  the  subjects  who  reported 
"alcohol  abuse  only"  had  the  lowest  rates  of  aftercare  attendance.  "Mixed 


alcohol  and  drug  abuse"  correlated  with  aftercare  attendance  at  a  rate  In 
between  the  other  two  categories.  Across  the  four  follow-up  Intervals,  the 
aftercare  attendance  rates  within  each  type  of  substance  category  declined. 
The  influence  of  type  of  substance,  however,  continued  to  affect  aftercare 
attendance  across  the  two  year  time  period.  Although  the  same  general 
patterns  were  noted,  the  correlation  between  type  of  substance  and  AA 
attendance  was  not  statistically  significant. 

Years  of  education  was  the  only  control  variable  to  show  a  consistent 
correlative  relationship  with  both  aftercare  attendance  and  AA  attendance 
for  more  than  one  follow-up  Interval.  Beginning  at  the  1 2-month  follow-up 
interview,  subjects  with  at  least  one  year  of  post  high  school  education 
consistently  reported  higher  rates  of  regular  AA  attendance  (see  Table  29). 
This  pattern  was  statistically  significant  for  the  last  three  follow-up 
periods.  After  subjects’  age,  years  of  education  accounted  for  most  of  the 
explained  variance  In  AA  attendance. 

While  the  same  general  pattern  Is  noted  In  the  relationship  between 
years  of  education  and  aftercare,  the  correlations  were  only  statistically 
significant  in  the  second  year  (see  Table  30).  For  both  educational 
categories  a  larger  percentage  of  subjects  attended  AA  as  opposed  to 
aftercare.  Most  subjects,  regardless  of  their  education,  stop  attending 
aftercare  within  the  first  year  of  follow-up.  For  both  educational 
categories  the  drop  out  rate  tended  to  be  spread  out  and  at  a  slower  rate  for 
AA  attendance,  with  more  subjects  remaining  with  AA  over  the  two  year 
time  frame. 


Tables  3 1  and  Table  32  summarize  the  relationships  between  the  two 
test  variables  and  the  eleven  outcome  variables.  Overall,  AA  attendance  and 
aftercare  were  unrelated  to  ten  of  the  eleven  outcome  variables.  AA 
attendance  produced  one  weak  correlation  with  the  number  of  injuries  for 
one  follow-up  period.  Aftercare  also  produced  several  weak  correlations 
with  part-time  employment,  and  one  weak  correlation  with  welfare 
assistance.  All  of  the  weak  correlations  resulted  In  measures  of 
association  that  were  so  small  as  to  make  the  relationships  meaningless.  In 
contrast,  both  AA  attendance  and  aftercare  were  significantly  associated 
with  sobriety  across  the  time  frame  of  the  study  and  resulted  in  small  to 
moderate  measures  of  the  magnitude  of  association. 

The  bivariate  analyses  of  the  relationships  between  the  two  test 
variables  and  1 1  selected  outcome  variables  were  conducted  using  SPSS 
subprogram  ANOVA.19  The  1 1  outcome  variables,  as  criterion  variables, 
were  measured  on  an  interval  scale.  Both  AA  attendance  and  aftercare 
attendance,  as  the  Independent  variables,  were  nonmetric  (categorical) 
variables.  Table  31  and  Table  32  summarize  the  findings  of  the  ANOVAs. 


19  As  originally  conceptualized,  this  design  had  planned  to  take  advantage  of  the  interval  quality 
of  many  of  the  outcome  variables  and  use  analysis  of  variance  to  explicate  the  relationships  among 
the  variables.  As  the  actual  data  analysis  progressed,  It  became  evident  that  crosstab  analysis, 
while  losing  the  Interval  quality  of  the  data,  allowed  for  a  more  intuitive  interpretation  of  the 
data,  and  was  better  suited  for  the  purposes  of  this  stud/.  Consequently  the  first  data  runs  on  the 
computer  utilized  SPSS  ANOVA  while  later  data  runs  used  SPSS  CROSSTABS.  Several  ANOVAs  were 
subsequently  rerun  on  CROSSTABS  with  no  differences  noted  in  terms  of  significance  of  outcome. 
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6  months  12  Months 


I.  Full-time  Employment 


2.  Part-time  Employment 


3.  Received  Welfare  Assistance 


A.  Received  Disability  Assistance 


5.  Hospitalized  for  Medical  Problems 


6.  Visits  to  the  Emeroencv  Room 


7.  Injuries 


8.  Hospitalized  for  Emotional  Problems 


9.  Alcohol  related  misdemeanors 


10.  Alcohol  related  felonies 


II.  Sobriet 


(8  not  sober  -  0,  sober  -  f ) 

( n.a.  *  F-test  not  significant  at  0.0 1 ) 

(0  -  F-test  significant  i  0.01 ,  but  R2  <  0.01 ) 

( +  =  positive  relationship  with  F-test  significant  i  0.0 1 ,  and  R2z  0.0 1 ) 
(-  =  negative  relationship  with  F-test  significant!  0.01,  and  R2z  0.01) 


Two  criteria  were  selected  for  determining  the  presence  of  a 
significant  relationship  between  a  test  variable  and  an  outcome  variable. 
First,  the  resulting  F-test  had  to  be  statistically  significant  at  a  s  0.01. 
Second,  the  statistically  significant  relationship  had  to  result  in  an  R2 1 
0.01,  i.e.,  account  for  at  least  one  percent  of  the  explained  variance  in  the 


20  See  Appendix  E-3  for  the  specific  data  which  are  summarized  in  this  table. 


dependent  variable.  Both  criteria  had  to  be  met  for  a  relationship  between 
the  test  variable  and  outcome  variable  to  be  considered  Important. 


1 .  Full-time  Employment 


2.  Part-time  Employment 


3.  Received  Welfare  Assistance 


4.  Received  Disability  Assistance 


5.  Hospitalized  for  Medical  Problems 


6.  Visits  to  the  Emerqency  Room 


7.  Injuries 


8.  Hospitalized  for  Emotional  Problems 


9.  Alcohol  related  misdemeanors 


10.  Alcohol  related  felonies 


1 1 .  Sobriet 


(a  not  sober  =  0,  sober  =  1 ) 

(n.a.  »  F-test  not  significant  at  0.01 ) 

(0  =  F-test  significant!  0.01,  but  R2<  0.01) 

( +  =  positive  relationship  with  F-test  significant  s  0.0 1 ,  and  R2*  0.0 1 ) 
(-  =*  negative  relationship  with  F-test  significant  i  0.01 ,  and  R2*  0.01 ) 


Table  31  summarizes  the  ANOVAs  between  AA  attendance  and  the  1 1 
outcome  variables.  Generally  speaking,  attending  AA  did  not  influence 
outcomes  in  10  of  the  1 1  dependent  variables.  AA  attendance  did  influence 


2 1  See  Appendix  E-4  for  the  specific  data  which  are  summarized  in  this  table. 


the  number  of  Injuries  reported  for  one  follow-up  interval  at  the  12  month 
interview.  While  statistically  significant  at  a  -  .001,  the  small  difference 
in  the  mean  number  of  injuries  during  the  second  follow-up  interval 
resulted  in  a  R2  of  0.007.22  m  other  woros,  the  difference ,  while 
statistically  significant,  accounted  for  such  a  small  portion  of  the  variance 
in  the  dependent  variable,  that  the  findings  were  essentially  irrelevant. 

For  the  most  part  same  patterns  were  observed  In  the  relationship 
between  aftercare  attendance  and  10  of  the  1 1  outcome  variables  (see  Table 
32).  Aftercare,  however,  did  produce  statistically  significant  relationships 
with  part-time  employment,  welfare  assistance,  and  hospitalization  for  one 
or  more  follow-up  Intervals.  The  statistically  significant  relationships  did 
not  account  for  at  least  one  percent  of  the  explained  variance  In  the 
dependent  variable.  Overall,  with  the  clear  exception  of  sobriety,  aftercare 
did  not  exert  an  Influence  on  the  outcome  variables. 

in  marked  contrast  to  the  other  outcome  variables,  AA  attendance 
(Table  31 )  was  significantly  related  to  the  number  of  months  of  sobriety 
across  the  entire  time  period  of  this  study.  Aftercare  attendance  (Table  32) 
was  also  significantly  related  to  sobriety  across  the  four  follow-up 
Intervals,  and  resulted  In  significant  R2s  In  two  of  the  four  time  periods. 

For  both  test  variables,  the  significance  levels  of  the  F-tests  across  the 
time  period  were  a  =  0.00 1 .  Comparing  AA  attendance  with  sobriety 
produced  R2s  ranging  from  0.061  to  0,10  over  the  two  year  time  period  of 

22  For  example,  at  the  1 2  month  Interview ,  1 ,0 1 9  subjects  who  did  not  attend  AA  had  a  mean 
number  of  Injuries  =  0.26.  239  subjects  who  attended  AA  once  a  month  had  a  mean  number  of 
Injuries  =  0.30.  1 68  subjects  who  attended  AA  several  times  a  month  had  a  mean  number  of 
Injuries  =  0.9 1 .  1 ,458  subjects  who  attended  AA  weekly  had  a  mean  number  of  Injuries  =  0.36. 
The  F-test  was  statistically  significant,  but  accounted  for  very  little  in  terms  of  "actual"  or  "real 
differences. 
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the  study.  The  comparison  of  aftercare  attendance  with  sobriety  produced 
R2s  ranging  from  0.008  to  0.021  over  the  two  year  time  period  of  this 
study.23 


23  The  ANOVAs  utilized  the  Interval  quality  of  the  dependent  variable  and  looked  at  the  number  of 
months  of  sobriety,  ranging  from  0-  6  within  each  follow-up  Interval.  When  the  variable 
categories  were  collapsed  Into  dichotomies  for  CROSSTABs,  the  resulting  t  were  comparable  with 

the  R2  from  the  ANOVA  analyses.  In  other  words,  It  did  not  appear  that  collapsing  the  variables 
resulted  In  any  loss  of  significant  data 


Table  33  summarizes  the  relationships  between  the  eight  control 
variables  and  sobriety  as  an  outcome  variable.  Tables  34  through  Table  37 
describe  the  relationships  between  sobriety  and  the  control  variables  for 
which  a  significant  relationship  could  be  demonstrated.  Overall,  the  impact 
of  the  control  variables  was  more  relevant  to  a  discussion  of  sobriety  than 
to  the  test  variables.  It  was  particularly  Interesting  to  note  that,  while  the 
control  variables  are  relevant  to  a  discussion  of  sobriety,  their  effect  was 
Isolated,  and  did  not  extend  to  either  of  the  test  variables  to  any  significant 
degree. 

As  noted  earlier  in  the  relationship  between  the  control  variables  and 
the  test  variables,  Tables  34  through  37  show  that  sobriety  added  more  to 
our  understanding  of  the  relationship  under  examination  than  did  the 
contribution  of  the  particular  control  variable  under  consideration.  The 
relatively  weak  contribution  of  the  control  variables  to  our  understanding  of 
sobriety  can  be  seen  in  the  measures  of  association  statistics  which 
accompany  the  graphs. 

Gender,  ethnicity,  employability,  and  education  did  not  demonstrate  a 
consistent  relationship  with  sobriety  across  the  follow-up  Intervals  of  this 
study  (see  Table  33).  Marital  status  and  type  of  substance  were 
statistically  related  to  sobriety  over  the  time  frame  of  the  study,  but  only 
produced  weak  measures  of  association.  Age  and  previous  treatment  for 
chemical  dependency  were  significantly  related  to  sobriety  and  produced 
small,  but  measurable,  measures  of  association. 
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Tab^e  33:  Summary  of  Analyses  between  the  Control  Variables 

and  Sobriety24 

Sobriety^ 


Control  Variables 

6., months 

12  Months 

18  Months 

Zj±lonths 

1.  Age 

+ 

+ 

+ 

+ 

2.  Gender 

n.a. 

n.a. 

0 

n.a. 

3.  Marital  Status 

♦a 

0 

+a 

♦a 

4.  Ethnicity 

n.a. 

n.a. 

n.a. 

n.a. 

5.  Employability 

n.a. 

n.a. 

n.a. 

n.a. 

6.  Previous  CD  Treatment 

+b 

+b 

+b 

n.a. 

7.  Type  of  Substance 

+c 

0 

+c 

0 

8.  Education 

n.a. 

+ 

n.a. 

n.a. 

(a  single  -  0,  separated  -  1 ,  together  -  2) 

(b  none  =  0,  one  or  more  *  1) 

( c  alcohol  only  *  0 ,  mixed  drugs  and  alcohol  =  1 ,  drugs  only  =  2) 
(n.a.  *  X2  not  significant  3t  0.01 ) 

( 0  *  X2  significant  i  0.0 1 ,  but  *  or  Cramer's  Y  <  0. 1 0) 

( +  =  positive  relationship  with  X2  significant  i  0.01 .  and  t  or 
Cramer's  Yi  0.10) 

( -  *  negative  relationship  with  X2  significant  i  0.0 1 ,  and  t  or 
Cramer’s  Y*  0.10) 


| 

i 

!  Table  34  shows  that  the  sobriety  rates  for  both  age  categories  were 

fairly  stable  over  the  two  years.  Subjects,  aged  30  and  younger,  were  less 
I  likely  to  report  sobriety.  The  relative  stability  of  the  graph  would  suggest 


24  See  Appendix  E-5  for  the  specific  data  which  are  summarized  in  this  table. 

25  Sobriety  was  dichotomized  as  either  "sober"  or  "not  sober"  In  the  bivariate  comparisons 
with  the  control  variables,  "Sober"  was  defined  as  six  continuous  months  of  sobriety  during  a 
follow-up  Interval.  Anything  less  than  complete  sobriety  was  considered  to  be  "not  sober". 
Clearly,  as  defined,  sobriety  Is  a  conservative  estimate  of  abstinence  from  alcohol  at  it  does  not 
take  Into  consideration  any  shorter  periods  of  abstinence  during  a  follow-up  interval. 


that,  for  this  sample,  the  contribution  of  age  to  the  differences  In  sobriety 
rates  was  fairly  constant.  The  relationship  between  sobriety  and  age 
graphed  in  Table  34  would  suggest  that  a  subject's  reporting  or  not 
reporting  sobriety  contributed  more  to  the  statistical  association  than  to 
which  age  category  a  subject  belonged.  Within  each  category  of  sobriety 
(sober  versus  not  sober)  the  contribution  of  age  would  appear  to  account  for 
about  a  \2%-  15%  difference  in  the  reported  sobriety  rates. 


6  months  12  months  18  months  24  months 

Tim*  Poriod 


( 06  months)  x2  ( 64  df )  =  1 4 1 .67  Cramer's  V  *  0.2 1 9 

( 12  months)  x2  (64 df)  -  11 7.98  Cramer's  V  =  0.200 

(18  months)  x2  (64 df)  *  135.41  Cramer's  V  =  0.214 

(24  months)  x2  (64df)  »  120.81  Cramer's  V  *  0.202 

Critical  value  with  64  df:  0.001  =  106.25 


0 


6  months  12  months  18  months  24  months 

Him  Period 


i 


(06  months)  x2  ( 13  df)  =  55.39 
(12  months)  x2  ( 1 3  df)  =  37.70 
(18  months)  x2  ( I3df)  *  36.25 
( 24  months)  x2  ( 1 3  df )  =  1 6.93  ( NS) 

Critical  value  with  1 3  df:  0.01  =  27.69 


Cramer's  Y  =  0.139 
Cramer's  V  =  0.1 15 
Cramer's  V  =  0. 1 1 2 
Cramer's  V  =  0.077 


Table  35  shows  that  the  majority  of  the  statistically  significant 
relationship  between  the  number  of  previous  admissions  for  chemical 
dependency  treatment  and  sobriety  was  the  result  of  the  Influence  of 
sobriety  rather  than  the  number  of  previous  admissions.  With  the  exception 
of  the  first  follow-up  period,  the  Influence  of  the  control  variable  was 
relatively  small,  and  did  not  extend  past  the  18  month  follow-up  Interview. 
Within  each  category  of  sobriety,  the  number  of  previous  admissions 
resulted  In  a  change  In  the  sobriety  rates  of  less  than  10%.  This 
relationship  was  relatively  stable  as  demonstrated  In  Table  35. 


-Q-  Alcohol  Yea 
•*■  Alcohol  No 
■*  Drug  Yea 
-+-  Drug  No 
D  &  A  Yea 
-*-  D  &  A  No 


6  months  12  months  18  months  24  months 

Time  Period 


(06  months)  x2  (2df)  =  37.04 
(12  months)  x2  (2  df)  -  16.54 
(18  months)  x2  (2df)  =  33.37 
(24  months)  x2  (2df)  =  22.24 

Critical  value  with  2  df:  0.00 1  *  1 3.82 


Cramer's  V  =  0. 1 1 4 
Cramer's  V  »  0.076 
Cramer's  Y  =  0. 1 08 
Cramer's  V  *  0.088 


Subjects  whose  Involvement  was  limited  to  alcohol  fared  better  than 
did  subjects  who  mixed  alcohol  with  oUvt  drugs,  or  abused  other  drugs  only 
(see  Table  36).  Subjects  who  mixed  drugs  and  alcohol  produced  sobriety 
rates  which  were  more  similar  to  the  "drug  abuse  only"  subjects  than  to  the 
"alcohol  only"  subjects.  The  magnitude  of  association  between  the  two 
variables  was  small,  which  suggested  that  the  interaction  between  the  two 
variables  did  not  contribute  very  much  to  the  subjects'  reports  of  sobriety. 


,V.V^,V>V. 


-o  Single  Yes 
-»■  Single  No 
♦  Separated  Yes 
Separated  No 
Together  Yes 
-*■  Together  No 


6  months  12  months  18  months  24  months 

Tima  Periad 


(06  months)  x2  <5  df)  *  46.31 
(12  months)  x2  (5df)  *  16.0? 

(18  months)  x2  ( 5  df)  *  34.48 
(24  months)  x2  (5  df)  *  28.27 

Critical  Value  with  5  df:  0.01  *  15.09 


Cramer’s  V*  0.126 
Cramer’s  V  *  0.074 
Cramer’s  V*  0.108 
Cramer’s  V  ■  0.098 


As  noted  In  the  previous  graphs  depicting  the  relationship  between 
the  control  variables  and  sobriety,  sobriety  appeared  to  contribute  more  to 
the  relationship  than  did  the  type  of  substance  chosen.  Within  each  category 
of  sobriety,  “alcohol  only",  as  the  type  of  substance  resulted  in  a  change  in 
the  sobriety  rates  of  approximately  107?  when  compared  to  the  other  two 
types  of  substance  categories.  Within  each  category  of  sobriety  there  were 
no  apparent  differences  between  the  remaining  types  of  substance 
categories, i.e.,  "drugs  only"  and  "mixed  drugs  and  alcohol." 
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The  relationship  between  marital  status  and  sobriety  followed  the 
patterns  described  above  for  the  other  control  variables.  Sobriety  provided 
a  greater  Influence  on  the  relationship  than  did  marital  status.  Table  37 
suggests  that  both  "separated"  and  “together"  were  fairly  stable,  with 
“single”  showing  a  little  more  variation.  The  difference  between  "single" 
and  the  other  two  categories  accounted  for  about  \0%  change  in  the  sobriety 
rates.  This  difference  remained  fairly  stable  across  the  four  follow-up 
Intervals. 


Both  AA  attendance  and  aftercare  were  significantly  related  to 
sobriety  across  the  time  periods  of  this  study.  The  measure  of  association 
for  the  relationship  with  AA  attendance  was  substantially  larger  than  was 
the  measure  of  association  with  aftercare,  Controlling  for  AA  attendance, 


Table  38:  Sobriety  by  AA  Attendance 


Time  Period 


-O-  Yes  AA 
No  AA 


(06  months)  X2  ( 1  df)=  100.89  Phi  =  .186 

( 1 2  months)  x2  ( 1  df)  «  1 84.84  Phi  =  .252 

( 18  months)  X2  ( 1  df)=  189.16  Phi  =  .255 

( 24  months)  x2  ( 1  df)  »  1 98.05  Phi  =  .260 


Critical  value  with  1  df:  0.01  »  6.63 


ni>  ■»rw..s."  .vl -„-\. -  -  v\m\- *w  w,  *t.  .v,  «*n  ^ 
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the  relationship  between  aftercare  and  sobriety  was  ambiguous  at  best  and 
did  not  explain  at  least  one  percent  of  the  variance  In  the  dependent 
variable.  As  stated  previously,  clarifying  aftercare  attendance  by  the 

Table  39:  Sobriety  by  Aftercare  Attendance 


Tim*  Period 


-o-  Yes  Aftercare 
No  Aftercare 


(06  months)  X2  ( 1  df)  =  34.95 
(12  months)  x2  ( 1  df)  =  53.26 
( 1 8  months)  x2  ( 1  df)  =  9.94 
(24  months)  x2  (i  df)  -  18.40 

Critical  value  with  1  df:  0.01  -  6.64 


Phi  =  0.110 
Phi  =  0.135 
Phi  =  0.05926 
Phi  =  0.080 


addition  of  the  variable, "Intensity  of  aftercare  services,"  did  not  Improve 
the  explanatory  power  of  aftercare  In  relation  to  sobriety. 


26  Although  the  chi  square  test  for  the  relatlonshl p  between  aftercare  attendance  and  sobriety 
was  statistically  significant,  the  measure  of  association  (e.g. ,  at  1 8  months,  t2  =  0.003)  was  so 
small  as  to  make  It  Irrelevant. 


■I**.*  »*.f4 
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A  moderately  strong  relationship  is  evident  In  Table  38,  between 
attending  AA  within  each  follow-up  period  and  the  subjects'  reports  of 
successfully  maintaining  their  sobriety  during  the  same  follow-up  period. 
The  difference  In  outcome  between  attending  and  not  attending  AA  was 
quite  pointed.  Subjects  who  did  not  attend  AA  appeared  to  struggle  to 
maintain  their  sobriety  at  a  level  averaging  20%  below  that  of  the  subjects 
who  attended  AA.  In  contrast,  subjects  who  attended  AA  show  a  gradual 
Improvement  In  their  sobriety  rates.  Improving  from  81.7%  to  87.2%  over 
the  two  year  time  frame. 

With  the  exception  of  the  Initial  follow-up  Interview  where  the 
difference  In  sobriety  rates  between  the  two  categories  of  AA  attendance 
was  only  16.7%,  the  20%  difference  In  sobriety  rates  between  the  AA 
attendance  categories  was  maintained  across  the  four  time  intervals.  While 
the  measure  of  association  between  AA  attendance  and  sobriety  was 
relatively  strong  in  comparison  to  the  rest  of  the  findings  of  this  study,  the 
proportion  of  variance  In  the  dependent  variable  being  accounted  for  by  the 
Independent  variable  was  still  relatively  low.  AA  attendance  accounted  for 
only  between  3.5%  and  6.8%  of  the  explained  variance  in  sobriety,  leaving 
the  majority  of  variance  remaining  to  be  explained.27 

The  relationship  between  attending  aftercare  and  sobriety  was  not  as 
clear-cut  nor  as  strong  as  was  the  relationship  between  AA  attendance  and 
aftercare  (see  Table  39).  The  subjects  who  did  not  attend  aftercare  showed 
the  same  struggle  to  maintain  their  rates  of  sobriety  as  did  the  previously 
described  subjects  who  did  not  attend  AA.  In  contrast  to  the  earlier 


27  In  a  2  X  2  contingency  table,  f2  =  r2 ,  and  measured  the  magnitude  of  the  association  between 
the  two  variables  in  terms  of  the  amount  of  explained  variance  in  the  dependent  variable.  ( Hays, 
1981,  p.557). 


V'  n'.V  V 


M 


mm 


■O'  AC  Yes  (No  AA) 
AC  No  (No  AA) 
♦  AC  Yes  (Yes  AA) 
AC  No  (Yes  AA) 


6  months  12  months  18  months  24  months 

Tim*  Period 


lime  Period 


( 06  months) 
( 1 2  months) 
( 1 8  months) 
( 24  months) 


Critical  value  with  1  df:  0.01  =  6.64 


1.64 

0.04 

10.26 

0.07 

8.23 

0.08 

9.15 

0.08 

0.20 

0.01 

0.15 

0.00 

6.73 

0.06 

0.57 

0.02 

discussion,  attending  aftercare  resulted  in  only  a  smaller  increase  in 
sobriety  rates  (ranging  from  6.3%  to  1 3.4%)  when  compared  with  the 
subjects  who  did  not  attend  aftercare. 


Subjects  who  attended  aftercare  did  not  show  the  same  degree  of 
Improvement  over  time  as  did  the  subjects  who  attended  AA.  Rather  than 
the  steady  Improvement  observed  in  the  AA  subjects  in  Table  38,  subjects 
attending  aftercare  tended  to  fluctuate  through  a  relatively  narrow  range  of 


Table  41:  AA  Attendance.  Aftercare,  and  Sobriety  Rates 


-a-  Aftercare 
AA  Attendance 
♦  Sobriety 


Tim*  Period 


sobriety  rates  from  79, 1  %  to  83,8%  (see  Table  39).  Using  the  earlier 
established  criteria  for  deciding  whether  a  relationship  existed,  aftercare 
ceased  to  demonstrate  a  relationship  with  sobriety  after  the  first  year  of 
follow-up. 

As  discussed  In  both  the  literature  review  and  earlier  in  this  chapter, 
there  has  been  some  indication  that  aftercare  may  interact  with  AA 
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attendance.  Exploring  this  possibility,  Table  40  looks  at  the  relationship 
between  sobriety  and  aftercare  controlling  for  the  effects  of  AA  attendance. 
As  can  be  seen  from  the  relationship  between  the  chi  square  tests  and  Phi 
statistics,  once  the  effect  of  AA  attendance  was  accounted  for,  the 
relationship  between  aftercare  and  sobriety  was  ambiguous  at  best.28 

Looking  at  Table  40  it  was  clear  that  AA  attendance  was  a  more 
important  influence  on  sobriety  rates  than  was  aftercare.  For  subjects  who 
did  not  attend  AA,  the  sobriety  rates  fluctuated  considerably,  suggesting  a 
lack  of  stability  in  the  maintenance  of  sobriety  over  time.  In  contrast, 
subjects  who  attended  AA  show  the  same  steady  improvement  in  their 
sobriety  rates  noted  earlier  In  this  chapter.  Although  not  significant  in 
terms  of  the  measure  of  association,  aftercare  did  provide  an  initial  boost 
in  the  sobriety  rates  for  AA  attenders  during  the  first  year  of  follow-up. 
This  initial  difference,  however,  disappeared  by  the  18  month  follow-up 
interview.  In  the  second  year  of  follow-up,  for  AA  attenders  there  were  no 
substantive  differences  In  sobriety  rates  when  comparing  AA  attenders  who 
attended  aftercare  and  those  who  did  not  attend  aftercare.29 

Table  41  combines  data  from  earlier  tables  to  look  at  the  relationship 
between  sobriety,  AA  attendance  and  aftercare  attendance,  in  this  study, 
subjects  reported  declining  attendance  for  both  AA  and  aftercare  across  the 
two  year  time  period.  It  was  Interesting  to  note,  however,  that  sobriety 
rates  remained  fairly  constant  cross  the  study  and  did  not  show  a  decrease 

28  As  discussed  previously,  given  the  large  sample  size,  for  a  relationship  to  be  considered 
significant,  the  X2  must  be  statistically  significant  i  0.0 1  and  t  must  be*  0. 1 0. 

29  In  fact,  a  close  examination  of  the  second  year  of  follow-up  for  AA  attenders  suggests  that 
subjects  who  attended  aftercare,  reported  slightly  lower  sobriety  rates  than  subjects  who  did  not 
attend  aftercare.  Although  the  X2  was  significant  at  24  months,  and  the  resulting  t  was  very 
small. 


V.V.V.V  •.-.V.V.V.V/ 


JS.' V- V A  A'.V.V.V 


1 
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in  rates  paralleling  the  decreases  in  the  rates  of  AA  attendance  and 
aftercare  attendance.  While  AA  attendance,  and  aftercare,  to  some  degree, 
were  related  to  sobriety,  there  were  other  factors  contributing  to  subjects' 
reports  of  sobriety  which  acted  to  sustain  subjects’  sobriety  while  their  AA 
attendance  and  aftercare  attendance  decreased. 


Takle.-42;.  Comparison  oLSofactely 

by  Aftercare  and  intensity  of  Aftercare** 


Aftercare  intensity  of  Aftercare 

Chi  square  PM  Chi  square  Cramer's  v 


Time  Period 


06  months 

34.95 

0.110 

13.99 

0.069 

1 2  months 

53.26 

0.135 

5.31 

0.042 

1 8  months 

9.94 

0.059 

3.65 

0.035 

24  months 

18.40 

0.080 

1.94 

0.026 

(Critical  value  with  1  df:  0.01  *6.64)  (Critical  value  with  2  df:  0.01  =9.21) 

As  discussed  earlier,  it  became  apparent  early  in  the  data  analysis 
that  the  construct-"aftercare"  was  confounded  with  mental  health 
treatment.  In  an  effort  to  Insure  that  the  effect  of  aftercare  was  not  being 
overlooked,  an  index  was  created  which  quantified  aftercare  by  the  types 
and  amounts  of  aftercare  services  offered  to  subjects  by  selected 
treatment  centers.  The  index  was  used  to  create  a  second  aftercare 


30  The  two  aftercare  variables  were  computed  on  different  sample  st2es.  "Aftercare"  was 
computed  on  the  stud/  sample  ( N  *  2 ,950).  "Intensity  of  aftercare" ,  as  a  subset  of  the  study 
sample  was  computed  on  an  N  =  2,059. 


variable  which  was  labelled  "Intensity  of  aftercare."  The  data  from  a 
subsample  of  treatment  centers  which  participated  In  the  creation  of  the 
index  were  reanalyzed,  using  a  three-level  (low-medium-high)  Intensity  of 
aftercare  variable.  Table  42  shows  that  "Intensity  of  aftercare"  correlated 
with  sobriety  for  only  the  first  follow-up  period  and  showed  even  less 
relationship  with  sobriety  than  did  “aftercare."  Aftercare,  whether 
conceptualized  as  a  dichotomous  attendance  variable,  or  three  levels  of 
intensity  was,  for  the  most  part,  unrelated  to  sobriety.31 


31  As  an  example,  In  a  multiple  regression  of  sobriety  at  1 2  months,  the  follow-up  period  for 
which  "aftercare”  produced  the  strongest  measures  of  association,  "Intensity  of  aftercare”,  when 
entered  Into  a  multiple  regression  equation  after  the  control  variables,  although  statistically 
significant,  resulted  in  a  R2change  of  only  0.003. 


Cross-lagged  panel  analysis  of  the  relationship  between  sobriety  and 
AA  attendance  suggested  that  the  relationship  was  real,  and  was  not  simply 
the  result  of  the  spurious  effect  of  an  unknown  third  variable  having  been 
related  independently  to  sobriety  and  AA  attendance,  and  producing  the 
appearance  of  a  relationship  where  none  existed.  The  interrelationships 
between  the  synchronous  correlations,  auto-correlations,  and  cross-lagged 
correlations  supported  the  hypothesis  that  AA  attendance  Influenced 
sobriety  more  than  the  reverse  situation  in  which  sobriety  influenced  AA 
attendance.  No  conclusions  could  be  drawn  about  the  cross-lagged  panel 
analysis  of  the  relationship  between  sobriety  and  aftercare  due  to  the 
relatively  weak  and  Inconsistent  correlations. 

In  the  previous  sections  of  this  chapter,  the  relationship  between 
sobriety  and  AA  attendance  has  been  demonstrated  to  be  statistically 
significant,  consistent  over  time,  and  accounting  for  a  measurable  degree  of 
the  variance  in  the  dependent  variable.  The  bivariate  analyses  between  the 
test  variables  and  sobriety  have  demonstrated  covariation,  i.e.,  that  the  two 
variables  did  not  operate  independently  of  each  other.  The  causal  issue, 
however,  regarding  the  differential  influence  of  one  variable  upon  the  other 
has  yet  to  be  addressed.  Labelling,  for  the  convenience  of  discussion,  one 
variable  Independent  and  the  other  variable  dependent  does  not  attribute 
causal  significance.32 

32  As  noted  by  Cook  and  Campbell  ( 1 979) ,  "it  does  not  matter  whether  the  pr  edictor  works 
because  It  Is  a  symptom  or  a  cause"  ( p.  286) 


In  an  effort  to  further  our  understanding  of  the  correlative 
relationship  between  AA  attendance  and  sobriety,  cross-lagged  panel 
analysis  was  used  to  explore  the  relationships  between  synchronous 


Table  43:  Cross-Lagged  Panel  Analysis  of  Sobriety  by  AA 

Across-theJ-Wdlear  Time  Frame  of  the  Study35 


.Mtendaacf 


6  mo  Sober  12  mo  Sober  18  mo  Sober  24  mo  Sober 


(1)  Time  1(6-  1 2  months)  z score:  -2.07  (NS) 

(2)  Time 2(  12- 18 months) zscore:  -2.28 

(3)  Time  3  ( 1 8-  24  months)  z  score:  -4.72 

At  a  =  0.0 1 ,  the  critical  z  score  *  -2. 1 7 

correlations,  autocorrelations,  and  cross-lagged  correlations  generated  by 
the  two  variables.34  Through  a  discussion  of  the  relationships  among  the 


33  As  discussed  in  "Chapter  Four:  Methodology”,  the  categories  of  both  variables  were  collapsed 
Into  dichotomies  and  treated  as  metric  variables  for  the  purpose  of  the  cross- lagged  panel 
analysis. 

34  See  Figure  3:  "Diagram  of  Cross-Lagged  Panel  For  Two  Variables  at  Iwo  Time  Periods," 
(Chapter  4,  p,  9 1 )  for  a  clarification  of  the  relationships  among  the  different  types  of 
correlations. 


three  types  of  correlations,  it  was  possible  to  begin  to  draw  inferences 
about  The  differential  influence  of  one  variable  upon  the  other.  This 
procedure  allowed  for  comments  about  the  apparent  directionality  of  effect 
between  the  two  variables,  as  well  as  rule  out  the  possibility  of  the 
spurious  influence  of  an  unknown  third  variable.35 

Cross-lagged  panel  analysis  explicates  relationships  across  time 
periods.  Table  43  depicted  the  correlations  between  AA  attendance  and 
sobriety  in  the  6-month  Interval  and  compared  them  with  correlations 
obtained  in  the  12-month  Interval.  In  like  fashion,  12-month  correlations 
were  compared  with  18-month  correlations,  and  18-month  correlations 
with  24-month  correlations  36  The  z-test,  developed  by  Peters  and 
VanVoorhls  (1940),  established  whether  the  difference  between  the  cross- 
lagged  correlations  was  statistically  significant,  when  the  synchronous 
correlations  and  autocorrelations  were  taken  into  account. 

The  synchronous  correlations  between  AA  attendance  and  sobriety  for 
each  time  period  appeared  to  be  stable,  noting  gradual  Increase  In  the  size 
of  the  correlation  from  r  =  0. 19  at  6  months  to  r  *  0.26  at  24  months.  The 
autocorrelations  between  sobriety  at  one  time  period  compared  with  the 
next  adjacent  time  period  demonstrated  the  same  consistent  increase  In 
strength  from  r  *  0.53  at  "time-  1 "  (6- 1 2  month  comparison)  to  r »  0.62  at 


35  Cross- lagged  panel  analysis  Is  an  extension  of  more  general  bivariate  analytical  techniques. 
Ruling  out  a  spurious  relationship  between  AA  attendance  and  sobriety  does  not  mean  that  other 
variables  are  not  associated  with  sobriety.  Ruling  out  a  spurious  relationship  simply  addresses 
the  possibility  of  a  third  variable,  Independently  related  to  both  the  predictor  and  outcome 
variable,  giving  the  appearance  of  a  relationship,  when  in  fact,  none  exists.  The  relative  strength 
of  the  relationship  may  still  be  weak ,  with  other  variables  contributing  to  an  explanation  of  the 
variance  In  the  outcome  variable. 

36  It  Is  also  possible  to  extend  the  cross- lag  panel  analysis  by  comparing  correlations  obtained 
at  one  follow-up  Interval  with  all  other  follow-up  Intervals.  One  could  hypothesize  that  the 
farther  apart  the  follow-up  Intervals  were  from  each  other,  the  weaker  would  be  the  resulting 
correlations. 


"time-  3"  ( 1 8-24  month  comparison),  in  a  similar  fashion,  the 
autocorrelations  Detween  AA  attendance  at  one  time  period  compared  with 
the  next  adjacent  time  period  demonstrated  the  same  increase  in  strength 
from  r  *  0.66  at  “time-  1"  (6-  12  month  comparison)  to  r  =  0.67  at  "time-  2” 
(12-  18  month  comparison).  The  “time-  3"  comparison  Is  essentially 
unchanged. 

The  cross-lagged  correlations  revealed  a  consistent  directional 
difference  in  the  relationships  between  the  first  time  period  and  the  second 
time  period  being  considered.  In  each  of  the  three  time  period  comparisons, 
the  cross-lagged  correlation  In  which  AA  attendance  (from  the  previous 
time  interval)  was  lagged  behind  sobriety  (from  the  next  time  interval),  was 
larger  than  the  cross-lagged  correlation  in  which  sobriety  (from  the 
previous  time  interval)  was  lagged  behind  AA  attendance  (from  the  next 
interval). 

In  each  case  AA  attendance  at  "time-  1"  would  explain  a  larger  proportion  of 
the  variance  In  subsequent  sobriety  at  "time-  2",  than  the  reverse  situation 
In  which  sobriety  at  "time-  1"  would  explain  subsequent  AA  attendance  at 
“time-  2".  This  difference  In  directional  strength  of  the  cross-lagged 
correlations  allowed  for  Inferences  about  the  relative  Influence  of  one 
variable  upon  the  other.  For  this  sample,  the  data  suggested  that  the  cross- 
lagged  correlations  for  two  of  the  three  comparisons  between  time 
intervals  were  statistically  significant.  In  the  third  comparison  the 
difference  In  the  cross-lagged  correlations  approached,  but  did  not  meet 
statistical  significance.37 

37  Obviously,  these  observations  are  only  provisional  In  nature.  Cross-  lagged  panel  analysis 
can  suggest  hypotheses  about  relationships  between  variables.  Confirmation  of  the  findings  would 
require  replication  In  an  experimental  design. 


6  mo  Aftercare 


12  mo  Aftercare 


18  mo  Aftercare 


24  mo  Aftercare 


(1)  Time  1  (6-  1 2  months)  z score;  -1,56  (NS) 

(2)  Time  2  (12- 18  months)  z  score:  -3.38 

( 3)  Time  3  ( 1 8-  24  months)  z  score;  - 1 .99  ( NS) 

At  a  =  0.0 1 ,  the  critical  z  score  *  -2. 1 7 


Given  the  relative  stability  among  the  three  types  of  correlations  it 
was  possible  to  draw  three  conclusions.  First,  for  two  of  the  three 
comparisons  It  is  possible  to  rule  out  the  possibility  of  a  spurious  influence 
of  a  third  and  unknown  variable  creating  the  appearance  of  a  relationship 
between  AA  attendance  and  sobriety.  Second,  the  data  suggested  that  AA 
attendance  had  a  greater  impact  on  subsequent  sobriety  In  this  sample,  than 

38  As  discussed  In  "Chapter  Four:  Methodology",  the  categories  of  both  variables  were  collapsed 
into  dichotomies  and  treated  as  metric  variables  for  th8  purpose  of  the  cross-  lagged  panel 
analysis. 


the  reverse  situation  In  which  established  sobriety  influenced  subsequent 
AA  attendance.  Third,  given  the  relatively  small  correlation  coefficients, 
while  suggestive  of  the  influence  of  AA  attendance  upon  subsequent 
sobriety,  one  must  conclude  that  most  of  the  variance  in  sobriety  remained 
to  be  explained. 

As  might  be  expected  from  the  earlier  discussion  of  the  relationship 
between  sobriety  and  aftercare  attendance,  the  picture  presented  by  a 
cross-lagged  analysis  of  sobriety  by  aftercare  did  not  clarify  the 
relationship  between  the  two  variables.  The  synchronous  correlations  In 
Table  44  show  that  a  consistent  relationship  between  sobriety  and 
aftercare  cannot  be  demonstrated  past  the  12-month  follow-up  Interview. 
While  all  three  comparisons  were  In  the  hypothesized  direction,  only  one 
pair  of  cross-lagged  correlations  between  1 2-months  and  18-months 
Identified  a  statistically  significant  relationship.  The  autocorrelations  for 
sobriety  were  relatively  stable.  In  contrast,  the  autocorrelation  (r  =  0.37) 
between  6-months  and  12-months  for  aftercare  suggested  that  something 
had  occurred  in  the  first  six  months  which  did  not  carry  over  to  the 
remaining  follow-up  periods  (r  *  0.68  and  r  =  0.69). 

Cross-lagged  panel  analysis  of  the  relationship  between  sobriety  and 
aftercare  did  not  support  the  hypothesis  that  over  the  two  year  time  frame 
of  this  study,  attending  aftercare  would  be  of  greater  significance  to 
sobriety  than  the  reverse  situation  In  which  sobriety  determined  aftercare 
attendance.  The  significance  of  the  comparison  of  the  one  pair  of  cross- 
lagged  correlations  (12  month- 18  month)  which  resulted  In  significant  z- 
test  score,  must  be  moderated  by  the  small  18-month  synchronous 
correlation  (r  =  0.06).  The  statistically  significant  comparison  between  the 


cross-lagged  correlations  was  essentially  Irrelevant,  as  the  comparison 
was  bounded  by  a  synchronous  correlation  between  aftercare  and  sobriety 
which  resulted  in  an  r2  of  0.004 


From  a  pool  of  Independent  variables  (  eight  control  variables  and  two 
test  variables),  for  each  follow-up  period,  SPSS  stepwise  multiple 
regression  selected  AA  attendance  as  the  variable  best  suited  to  explain  the 
variance  in  sobriety.  Aftercare  was  selected  In  a  similar  fashion  for  only 
the  6-month  and  12-month  follow-up  period.  In  both  instances,  the 
additional  explanatory  power  (R2  change)  provided  by  aftercare  was 
negligible. 

In  a  separate  multiple  regression  In  which  the  control  variables  were 
entered  as  a  block  prior  to  consideration  of  the  test  variables,  for  each 
follow-up  period  AA  attendance  continued  to  be  statistically  significant  and 
accounted  for  the  majority  of  the  explanatory  power  of  the  squared  multiple 
correlation  (R2).  After  taking  into  account  both  the  control  variables  and 
AA  attendance,  aftercare  was  statistically  significant  for  all  follow-up 
periods.  The  additional  Increment  of  explanatory  power  provided  by 
aftercare,  over  and  above  that  already  contributed  by  the  other  variables, 
was  so  small  as  to  be  meaningless. 

The  cross-validation  of  the  multiple  regression  results  suggested 
that  the  relationships  among  variables,  described  by  the  multiple 
regression,  were,  In  fact,  substantiate  rather  than  spurious.  While  AA 
attendance  did  account  for  a  portion  of  the  variance  In  sobriety,  clearly  the 
majority  of  the  variance  remained  to  be  explained.  Discriminant  analysis  of 
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sobriety  Indicated  that  knowledge  of  the  Independent  variables  improved 
probability  of  correctly  predicting  sobriety  by  12.8%-  15.5  %, 

Multiple  regression  Is  a  "well  established  data  analytic  procedure" 
and  has  long  been  the  "method  of  choice"  for  studying  the  relationship 
between  one  dependent  variable  and  a  group  of  two  or  more  independent 
variables.  (Bentler,  et  a).,  1976,  p.  161 ).  This  approach  was  used  to  examine 
the  relationships  among  the  independent  variables  to  explore  their  relative 
contribution  to  an  explanation  of  the  variance  In  the  dependent  variable.  The 
results  of  the  multiple  regression  analysis  were  subsequently  cross- 
validated  to  see  whether  the  relationships  Identified  In  the  development  of 
the  multiple  regression  equations  would  hold  up  when  the  equations  were 
applied  to  a  second  sample.39 

For  each  six-month  follow-up  Interval,  sobriety,  as  the  dependent 
variable,  was  treated  as  an  Interval  variable,  ranging  from  0-  6  months 
sobriety  for  each  follow-up  Interval.  The  eight  control  variables  previously 
identified,  in  combination  with  the  two  test  variables  (AA  attendance  and 
aftercare  attendance),  comprised  the  independent  variables  for  the  multiple 
regression  analysis.  Three  variables  (age,  education,  and  number  of  times 
previously  treated  for  chemical  dependency)  were  treated  as  interval 
variables.  Dummy  coding  was  used  to  compare  the  three  categories  of  type 
of  substance  abuse.  40  Marital  status  was  collapsed  Into  a  dichotomous 
variable  of  "single"  versus  "together."  Ethnicity  was  collapsed  Into  a 

39  As  previously  discussed,  using  a  random  numbers  process,  the  stud/  sample  was  divided  into 
two  subsamples.  The  multiple  regression  equations  were  developed  on  the  first  subsample  and 
subsequently  cross- validated  on  the  second  subsample. 

40  "ALCSA"  contrasted  "alcohol  only"  with  "mixed  drugs  and  alcohol. "  "ALCSB "  contrasted 
"alcohol  only"  with  "drugs  only." 


Variable _ R2 _ Slg.  R2  Change 


LMflQthiflllflWzua 


AA  Attendance 

0.056 

— 

Age 

0.068 

0.013 

Prior  Tx 

0.082 

.0000 

0.014 

Aftercare 

0.087 

.0000 

Ethnicity 

0.090 

.0000 

12  Month  Follow-up 

AA  attendance 

0.097 

.0000 

Aftercare 

0.104 

.0000 

Age 

0.110 

.0000 

Employability 

0.113 

.0000 

AA  attendance 

0.073 

.0000 

— 

Age 

0.085 

.0000 

0.012 

Prior  Tx 

0.092 

.0000 

MB 

Sex 

0.096 

.0000 

HI 

Employability 

0.099 

.0000 

EH 

AA  attendance 

0.079 

.0000 

— 

AA  attendance 
Age 


0.079 

0.089 


,0C 

,0C 


M 


dichotomous  variable  of  "white"  versus  "other."  Employability  and  gender 
were  treated  as  dichotomous  variables,  as  were  both  test  variables. 

In  the  first  step  of  the  multiple  regression  analysis,  all  Independent 
variables  (both  test  variables  and  control  variables)  were  entered  into  the 
regression  equation  In  a  stepwise  fashion.41  Stepwise  regression  was 
chosen  to  see  what  were  the  relationships  among  the  Independent  variables 
and  the  dependent  variable  without  designating  the  Independent  variables  as 
either  control  variables  or  test  variables.  Each  of  the  four  follow-up 
intervals  were  treated  separately.  As  can  be  seen  In  Table  45,  the  ordering 
and  size  of  the  resulting  “R2"  and  ”R2  change"  statistics,  provided  an 
Indication  of  the  relative  contribution  in  the  regression  of  sobriety  of  each 
of  the  Independent  variables. 

The  first  Independent  variable  selected  by  the  SPSS  subprogram 
"Regression"  explained  the  "greatest  amount  of  variance  in  the  dependent 
variable'  (Nie  et.  al.,  1975.  p.  345).  Table  45  shows  that  for  each  follow-up 
interval,  in  a  stepwise  fashion,  AA  attendance  was  selected  as  the  most 
Important  Independent  variable  In  terms  of  Its  contribution  to  the 
explanation  of  the  variance  associated  with  sobriety.  The  "multiple  R" 
ranged  from  0.236  to  0.31 1  which  explained  from  5.5%  to  9.7%  of  the 
variance  in  sobriety.  All  F-tests  were  significant  beyond  0.0000. 

Aftercare  was  selected  in  a  stepwise  fashion  in  only  the  first  two 
follow-up  Intervals.  In  the  6-month  follow-up  Interval,  aftercare  was  the 
fourth  variable  selected.  While  the  F-test  associated  with  the  Inclusion  of 
aftercare  was  statistically  significant  (0.0065),  the  "R2  change"  statistic 

4 !  SPSS  default  parameters  were  used  to  establish  stepwise  inclusion  criteria.  See  "Chapter 
Four:  Methodology." 
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shows  that  the  addition  of  afterr  ~e  to  the  regression  equation  only 
increased  the  explanation  of  the  outcome  variance  by  0.5%.  In  the  1 2-month 
follow-up  interval,  while  aftercare  was  chosen  as  the  second  variable  to  be 
entered  Into  the  regression  equation,  the  "R2  change"  statistic  showed  that 
aftercare  only  added  0.7%  to  our  understanding  of  the  outcome  variance. 
Aftercare  was  not  selected  for  stepwise  Inclusion  in  either  the  18-month 
follow-up  Interval  or  the  24-month  follow-up  Interval. 

Only  four  control  variables  were  selected  when  SPSS  subprogram 
"Regression"  was  allowed  to  choose  freely  from  among  the  independent 
variables  for  Inclusion  on  the  basis  of  their  relative  contribution  to  the 
explanation  of  the  variance  of  the  dependent  variable.  Age  was  selected 
across  all  four  time  Intervals,  and  was  the  second  variable  chosen  In  three 
of  the  four  follow-up  periods.  Prior  admission  for  chemical  dependency 
treatment  was  selected  for  three  time  periods,  while  ethnicity,  sex,  and 
employability  were  each  selected  for  two  time  periods. 

Taking  note  of  the  associated  "R2  change",  however,  only  age  and  prior 
admissions  for  chemical  dependency  treatment  produced  a  measurable 
increase  in  the  percent  of  explained  variance  In  the  6-  month  follow-up 
interval.  Age  produced  a  measurable  Increase  In  the  percent  of  explained 
variance  In  the  18  -  month  follow-up  Interval.  Otherwise  the  control 
variables  were  essentially  Irrelevant  In  terms  of  adding  to  the  explanation 
of  the  variance  In  the  dependent  variable.  Marital  status,  years  of 
education,  type  of  substance  abuse  were  not  selected  by  stepwise 
regression  in  any  of  the  follow-up  intervals. 


R2 change 


Block  Variables  6  mo.  !2mo.  i8mo.  24  mo. 


Control 


+ 


AA  Attendance 


+ 


Aftercare 


0.032 


0.054 


0.005 


0.018  0.024  0.021 


0.091  0.070  0.075 


0.007  0.000  0.000 


Z  (Multiple  R2) 


0.091  0.116  0.094  0.096 


SMnjLyadablss43 


&jn& _ 

age 

prior  treatment 

ethnicity 

employability 


J  2  mo. _ 18  mo. 

ethnicity  age 

age  sex 

employability  employability 

sex 


21m 

age 

sex 

employability 


42  The  eight  control  variables  were  entered  as  a  block.  Within  the  block ,  the  variables  were 
entered  In  a  stepwise  fashion,  using  the  SPSS  default  parameters  as  Inclusion  criteria.  After  all 
control  variables  had  been  entered,  AA  attendance  was  entered  into  the  equation  as  a  second  block. 
Aftercare  was  entered  as  a  third  block  if  it  met  the  inclusion  criteria. 

43  Control  variables  listed  in  terms  of  their  relative  contribution  to  the  explanation  of  the 
outcome  variance.  Within  their  block,  the  control  variables  were  entered  into  the  regression 
equation  In  a  stepwise  fashion. 


While  stepwise  regression  of  the  Independent  variables  on  sobriety 
provided  one  perspective  about  their  relationships,  a  second  perspective 
was  obtained  by  entering  all  of  the  control  variables  as  a  block,  prior  to 
entering  the  test  variables.  This  approach  looked  at  the  strength  of  the 
contribution  of  the  test  variables,  vis-a-vis  the  control  variables,  in  the 
explanation  of  the  variance  in  sobriety.  Could  the  influence  of  AA 
attendance  and  aftercare  be  demonstrated  after  the  contribution  of  the 
control  variables  had  been  taken  into  account? 

Table  46  shows  that  the  control  variables,  when  entered  as  a  block, 
account  for  a  very  small  percentage  of  the  variance  in  sobriety.  At  the  6- 
month  follow-up  interview,  the  control  variables  explained  only  3.4%  of  the 
variance  In  sobriety.  By  the  12-  month  interview,  this  percentage  had 
dropped  to  1.8%.  In  the  second  year  of  follow-up,  the  contribution  of  the 
control  variables  to  the  explanation  of  the  variance  In  sobriety  remained 
relatively  stable,  only  declining  from  2.4%  to  2.1%.  Age  was  the  most 
Important  control  variable  in  terms  of  Its  relative  contribution  to  the 
explanation  of  the  variance  in  the  dependent  variable. 

Having  previously  taken  the  control  variables  Into  consideration,  AA 
attendance  explained  the  largest  percent  of  the  variance  In  sobriety.  When 
compared  with  the  control  variables  and  aftercare,  AA  attendance  accounts 
for  the  majority  of  the  explained  variance  in  sobriety,  ranging  from  59%  at 
6  months  to  78%  at  24  months.  The  percent  of  variance  in  sobriety 
accounted  for  by  AA  attendance  increases  between  6-months  and  12-months 
and,  to  a  lesser  degree,  between  18-months  and  24-months. 

After  both  the  control  variables  and  AA  attendance  were  added  to  the 
regression  equation,  an  attempt  was  made  to  add  aftercare  to  the  multiple 
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regression  equation.  As  can  be  seen  from  Table  46,  aftercare  added  only  a 
negligible  amount  to  the  explanation  of  the  variance  In  sobriety.  Table  46 
shows  that  while  aftercare  continued  to  be  statistically  significant  at  both 
18  months  and  24  months, and  was  entered  Into  the  multiple  regression 
equation,  Its  contribution  to  the  explanation  of  the  variance  In  sobriety  was 
not  measurable.  In  terms  of  substantial  explanatory  power,  aftercare  did 
not  add  to  the  explanation  of  the  variance  In  sobriety  once  AA  attendance 
and  the  control  variables  had  been  taken  Into  consideration. 

The  multiple  regression  analyses  described  In  Table  45  and  Table  46 
were  developed  on  a  subsample  of  1435  subjects,  selected  in  a  random 
fashion  from  the  larger  study  sample.  One  question  that  can  be  asked  was 
whether  these  relationships  represented  substantive  findings  which  might 
be  expected  to  be  observed  In  other  samples,  or  were  they  spurious  and 


Follow-up  Period 

Multiple  R 

Cross-Validation  r 

Sig. 

6  months 

0.302 

0.281 

0.001 

1 2  months 

0.341 

0.322 

0.001 

18  months 

0.306 

0.317 

0.001 

24  months 

0.310 

0.334 

0.001 

simply  the  combination  of  happenstance  and  a  large  sample  size?  To 
address  these  issues,  a  second  and  mutually  exclusive  subsample  of  1515 
subjects  was  selected  In  a  random  fashion  from  the  study  sample.  Using  the 
two  subsamples,  the  multiple  regression  equations  from  the  first  sample 
were  used  to  predict  outcome  scores  for  each  subject  in  the  second  sample. 
The  predicted  outcome  scores  were  then  compared  with  the  actual  outcome 
scores  by  generating  a  Pearson  r,  calculated  between  the  observed  outcome 
scores  and  the  predicted  outcome  scores  for  the  second  sample.  As 
previously  noted  that  the  resulting  Pearson  r  “was  analogous  to  a  multiple 
correlation”  for  the  second  sample,  using  the  regression  equations  from  the 
first  sample  (Pedhazur,  1982). 

In  Table  47,  the  multiple  Rs  of  the  first  (development)  sample  were 
compared  with  the  Pearson  rs  from  the  second  (cross-validation)  sample.  A 
perfect  fit  between  the  regression  equations  of  the  development  sample  and 
the  data  from  the  cross-validation  sample  was  highly  unlikely.  The  cross- 
validation  r  of  the  second  sample  Is  expected  almost  always  to  be  smaller 
than  the  development  multiple  R  from  the  first  sample  due  to  sampling 
error,  etc.  (Pedhazur,  1982,  pp.  147-  148). 

As  can  be  seen  In  Table  47,  this  was  true  for  the  6-month  and  1 2- 
month  time  periods.  It  is  interesting  to  note,  however,  that  the  "cross- 
validation  rs”  for  both  the  18-month  and  24-mor.th  time  periods  were  larger 
than  the  "development  Rs"  with  which  they  were  compared.  This  Increase 
was  essentially  meaningless  and  merely  highlighted  the  effect  of  sampling 
error.  Comparing  the  absolute  differences  between  the  multiple  R  and  the 
Pearson  r,  It  can  be  seen  that  shrinkage  (or  absolute  difference)  was 
relatively  small,  it  was  concluded  that  the  multiple  R  between  sobriety  and 


the  Independent  variables  (control  and  test ),  while  not  indicative  of  a 
particularly  strong  relationship,  did  reflect  the  presence  of  a  meaningful 
relationship  which  held  up  when  compared  with  a  second  sample. 

Taking  the  control  variables  into  consideration,  the  multivariate 
analysis  of  the  study  data  suggested  that  AA  attendance  was  clearly  related 
to  sobriety  across  the  two  year  follow-up  period.  In  terms  of  the  variables 
examined  in  this  study,  AA  attendance  was  more  important  than  all  the 
other  independent  variables,  taken  together,  In  explaining  the  variance  in 
sobriety.  In  contrast,  the  effect  of  aftercare,  when  all  other  Independent 
variables  had  been  accounted  for,  was  very  minimal  during  the  first  year  of 
follow-up.  No  effect  for  aftercare  could  be  demonstrated  beyond  the  first 
year  of  follow-up.  In  terms  of  variance  in  sobriety,  It  must  be  noted  that 
the  majority  of  the  variation  remained  to  be  explained. 

The  significance,  as  well  as  limitations  of  the  model  hypothesizing 
the  relationships  between  the  test  variables  and  sobriety,  can  be  further 
demonstrated  through  the  use  of  discriminant  analysis,  a  data  analysis 
technique  which  combined  the  independent  variables  In  in  such  a  fashion 
that  the  subjects  could  be  divided  Into  groups  on  the  basis  of  their 
dependent  variable  scores.  Discriminant  analysis  seeks  to  classify  subjects 
into  groups  which  were  as  statistically  distinct  on  the  dependent  variable 
as  possible  (Nle,  1975,  p.  435).  The  Influence  of  a  model  which  explained 
sobriety  on  the  basis  of  control  variables  and  the  two  test  variables  could 
then  be  determined  by  its  ability  to  successfully  predict  subjects’  sobriety. 

Discriminant  analysis  was  used  to  calculate  a  discriminant  function 
which  combined  the  eight  control  variables  and  two  test  variables  to 
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predict  sobriety  outcomes.44.45  Subjects  received  predicted  outcome  scores 
which  divided  them  Into  two  groups  which  were  as  distinct  as  possible.  The 
predicted  outcome  scores  were  then  compared  with  the  actual  outcomes  to 
assess  the  effectiveness  of  the  discriminant  function  to  predict  sobriety 
outcomes  for  the  subsample  on  which  the  discriminant  function  was 
developed.46 


Sober  Not  Sober  Mean  Sample 


6  months 

66.4 

62.3 

65.5 

1 2  months 

64.2 

68.9 

65.4 

1 8  months 

62.8 

68.9 

64.3 

24  months 

60.1 

71.6 

62.8 

44  The  discriminant  analysis  was  computed  using  SPSS  subprogram  "Discriminant  Analysis". 
Variables  were  selected  using  the  SPSS  default  settings.  Control  variables  were  entered  first,  in  a 
stepwise  fashion  followed  by  the  two  test  variables.  Given  the  dichotomous  nature  of  the  dependent 
variable,  only  one  discriminant  function  was  computed. 

45  See  Appendix  F  for  the  specific  results  of  the  discriminant  analysis. 

46  The  same  subsample  was  used  to  develop  the  multiple  regression  equations  and  the 
discriminant  function. 
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A  model  which  predicted  sobriety  on  the  basis  of  the  eight  control 
variables  and  two  test  variables  Improved  the  ability  to  predict  sobriety  to 
a  limited  degree.  If  subjects'  AA  attendance,  as  the  most  potent  of  the 
independent  variables,  were  unrelated  to  sobriety,  an  equal  distribution  of 
subjects  between  the  sober  and  not  sober  categories  would  have  been 
predicted.  In  Table  48  it  can  be  seen  that  knowledge  of  the  independent 
variables  improved  the  predictive  rate  between  12.8%  and  15.5%. 

While  AA  attendance  did  account  for  a  portion  of  the  variance  in 
sobriety,  the  majority  of  the  variance  remained  to  be  explained.  Other 
factors,  not  addressed  In  this  study,  appeared  to  have  been  an  influence  on 
subjects'  sobriety  outcomes.  This  was  evident  in  the  average  predictive 
error  rate  which  ranged  from  34.%  to  37.2%.  Knowledge  about  AA 
attendance,  aftercare,  and  the  control  variables  predicted  "not  sober" 
outcomes  better  than  "sober"  outcomes.  The  ability  of  the  model  to  predict 
"not  sober”  outcomes  Improved  over  time,  while  the  ability  of  the  model  to 
predict  "sober"  outcomes  decreased  over  time.  Clearly,  there  are  other 
factors  remaining  to  be  identified  which  may  have  had  an  impact  on  the 
sobriety  outcomes. 
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The  results  of  the  data  analysis  presented  In  the  last  chapter  are 
discussed  In  this  chapter.  The  chapter  is  divided  Into  two  sections.  The 
first  section  discusses  the  results  of  the  data  analysis  In  light  of  the 
research  questions  and  hypotheses  developed  In  the  third  chapter,  in  the 
second  part  of  the  chapter,  the  limitations  of  this  study  are  critiqued,  both 
in  terms  of  general  secondary  analysis  issues  and  specific  problems 
experienced  with  this  research. 


Question  l:  Was  there  a  significant  relationship  between 
AA  attendance  and  the  control  variables? 


l  For  each  time  period,  there  was  no 


relationship  between  attending  AA  and  each  of  the  eight 
control  variables. 


No  Relationship  between 


M  Attendance  and: 

6  months  1 2  months  1 8  months  24  months 


Age 

No 

No 

No 

No 

Gender 

No 

No 

No 

No 

Marital  Status 

No 

No 

No 

No 

Ethnicity 

No 

No 

? 

No 

Employability 

No 

No 

NO 

No 

Previous  CD  Tx 

? 

? 

? 

No 

Type  of  Substance 

No 

No 

No 

No 

Education 

No 

Yes 

Yes 

Yes 

0  =  unable  to  reject  null 

hypothesis  at  a  = 

0.01) 

=  equivocal- a  =  0.01, 

but  +  or  Cramer's 

>  V  <  0.10) 

(Yes  *  able  to  reject  null  hypothesis  at  0.01  and*  or  Cramer'sv  1  0.10) 


There  was  little  indication  that  there  were  any  significant 
interactions  between  the  eight  control  variables  and  AA  attendance  (see 
Table  49).  For  the  majority  of  the  expected  relationships  between  AA 
attendance  and  the  control  variables,  the  null  hypotheses  could  not  be 
rejected.  This  outcome  was  in  itself  surprising  as  age  and  gender  In 
particular  were  expected  to  have  an  impact  on  AA  attendance.  The  absence 
of  interaction  between  AA  attendance  and  age  and  gender  may  have  been  due 
more  to  the  population  from  which  the  sample  was  drawn  than  to  factors 
inherent  in  the  variables  themselves.  This  finding  did  lend  support  to  AA's 
contention  that,  as  a  self-help  group,  its  resources  are  utilized  by  a  broad 
spectrum  of  the  U.S.  population  (AA  World  Services,  1984). 


As  previously  suggested,  a  distinctive  characteristic  of  this  sample, 
when  compared  with  other  samples  reported  in  the  literature,  is  that  it  was 
not  selected  from  the  more  typically  studied  population  of  indigent  middle- 
aged  males  treated  in  public  institutions.  As  alcoholism  treatment  becomes 
a  more  acceptable  resource  for  larger  sections  of  the  U.5.  population,  their 
presence  will  be  reflected  in  the  outcome  results.  As  alcohol  treatment 
moves  beyond  the  treatment  of  chronic  inebriates,  other  demographic 
features  will  be  represented  more  frequently  in  the  research  literature. 

Due  primarily  to  the  socioeconomic  characteristics  of  AA  membership 
in  its  formative  years,  a  public  conception  about  AA  developed  that  it  was  a 
support  group  for  those  "who  had  lost  their  jobs,  hit  Skid  Row,  and  had 
completely  disrupted  their  family  life  and  social  relationships "  (Robinson, 
1979,  p.  29). 1  Years  of  education  was  included  in  this  study  because  it  was 
one  of  the  few  CATOR-ll!  items  which  provided  a  rough  indicator  of 
socioeconomic  status  of  the  subjects  in  this  sample.  In  general,  more 
education  has  been  associated  with  stable  employment  and  higher  paying 
jobs.2 

In  the  literature,  the  relationship  between  socioeconomic  status  and 
AA  attendance  was  ambiguous.  Knight  et  al.  ( 1 980)  hypothesized  that  self- 
help  groups  tended  to  be  utilized  by  a  working  class  population,  while 
upper-middle  class,  well  educated  persons  tended  to  seek  out  more 
conventional  modes  of  therapy  (p.  60).  Vaillant  ( 1 983),  on  the  other  hand, 

1  Clinebell  ( 1 968),  In  writing  one  of  the  first  treatment  manuals  for  alcoholics  wrote,  in  the 
early  1 950s  that  "  a  high  proportion  of  AA  members  were  considered  hopeless  by  their  family, 
friends,  doctors  and  clergymen"  (p.  1 1 9).  "The  low-bottom  alcoholic  provided  the  stereotype  of 
what  all  alcoholics  were  supposed  to  be  like"  ( p.  26). 

2  For  detailed  discussion  see  the  discussion  of  socioeconomic  status  indicators  in  Pollch  et  al. , 
1980  &  1981). 
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found  no  differences  in  AA  attendance  between  his  college  educated 
subsample  and  an  inner  city  working  class  comparison  sample  (p.  207). 

Poley  et  al.  (1979)  reported  that  AA  membership  draws  from  the  "lower- 
middle  to  upper-middle  socioeconomic  levels"  (p.  48). 

Beginning  with  the  12-month  follow-up  Interview,  years  of  education 
was  the  one  control  variable  which  was  significantly  related  to  AA 
attendance  In  three  of  four  follow-up  Intervals.  Subjects  with  more  than  12 
years  of  education  had  somewhat  higher  AA  attendance  rates,  which  ranged 
from  68. 1  %  at  6  months  to  52.2%  at  24  months.  Subjects  with  12  years  of 
education  or  less  reported  somewhat  lower  AA  attendance  rates  which 
ranged  from  61.5%  at  6  months  to  45.7%  at  24  months  (see  Table  29) 

Approximately  6.6%  more  subjects  in  this  sample  with  at  least  high 
school  education  attended  AA  than  did  subjects  with  less  than  a  high  school 
education.  This  difference  in  AA  attendance  rates  was  constant  for  the 
years  of  education  across  the  two  year  follow-up  period.  For  this  sample,  in 
terms  of  the  years  of  education,  the  data  supported  a  hypothesis  that  AA 
attendance  was  at  least  as  attractive  to  middle  class  subjects  as  it  was  to 
working  class  subjects.  In  fact,  subjects  who  reported  at  least  a  college 
education  (>  16  years  of  education)  had  AA  attendance  rates  which  ranged 
from  70.7%  at  6  months  to  57.2%  at  24  months, 

Table  27  shows  that  subjects  who  had  been  previously  admitted  for 
chemical  dependency  treatment  reported  that  they  were  slightly  more  likely 
to  attend  AA.  This  finding,  while  statistically  significant  for  the  first 
three  follow-up  periods,  resulted  In  such  small  measures  of  association  as 


to  have  very  little  Interpretive  meaning,3  Other  than  education  and  previous 
treatment,  little  difference  was  found  between  subjects  who  attended  AA 
and  those  who  did  not  attend  AA,  In  terms  of  the  subjects’  use  of  AA,  this 
absence  of  significant  relationships  between  AA  attendance  and  the  control 
variables  was  a  positive,  If  unexpected,  outcome. 


Question  2:  Was  there  a  significant  relationship  between 
aftercare  attendance  and  the  control  variables? 

Null  Hypotheses:  For  each  time  period,  there  was  no 
relationship  between  attending  aftercare  and  each  of  the 
eight  control  variables. 

The  same  general  pattern  Identified  above  regarding  the  relationship 
between  AA  attendance  and  the  control  variables  was  evident  in  the 
relationship  between  aftercare  attendance  and  the  control  variables  (see 
Table  50).  The  majority  of  the  null  hypotheses  could  not  be  rejected.  The 
interaction  between  aftercare  and  the  control  variables  tended  to  involve 
different  variables  from  those  interacting  with  AA  attendance.  The 
majority  of  the  relationships  were  rather  weak,  with  only  gender,  type  of 
substance,  and  years  of  education  resulting  in  a  measure  of  association  of 
any  size.  The  interaction  between  aftercare  and  both  employability  and 


3  This  finding,  however,  neatly  fits  with  theAA  adage  that  "if  you  aren’t  ready  to  stop  drinking, 
go  out  and  drink  some  more... you’ 11  be  back,". 


No  Relationship  between  Null  Hypothesis  Rejected.? 

Aftercare  Attendance  and; 


6  months 

12  months 

18  months 

24  months 

1.  Age 

No 

No 

No 

No 

2.  Gender 

Yes 

Yes 

Yes 

Yes 

3.  Marital  Status 

No 

No 

No 

4.  Ethnicity 

No 

No 

7 

No 

5.  Employability 

7 

No 

No 

No 

6.  Previous  CD  Tx 

No 

No 

No 

No 

7.  Type  of  Substance 

? 

7 

7 

Yes 

8.  Education 

No 

No 

Yes 

Yes 

( No  =  unable  to  reject  null  hypothesis  at  a  =  0.0 1 ) 

( ?  =  equivocal-  a  =  0.0 1 ,  but  +  or  Cramer's  V  <  0. 1 0) 

(Yes  =  able  to  reject  null  hypothesis  at  0.0 1  and  t  or  Cramer's  Y  2  0. 1 0) 


Females  consistently  had  a  higher  rate  of  aftercare  attendance  than 
did  the  males.  Females  reported  aftercare  attendance  rates  which  ranged 
from  47.8%  at  6  months  to  23.2%  at  24  months,  while  males  reported 
aftercare  attendance  rates  which  ranged  from  41 . 1  %  at  6  months  to  1 4.8%  at 


4  As  was  noted  in  the  narrative  accompanying  the  graphs  in  the  fourth  chapter ,  the  measures  of 
association  between  the  control  variables  and  aftercare  were  more  affected  by  whether  clients 
attended  aftercare  than  their  classification  on  the  particular  control  variables.  The  measures  of 
association,  in  themselve-:,  were  relatively  small. 
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24  months  (see  Table  26).  The  gender  differences  slightly  increased  over 
the  two  year  period,  from  6.8ft  more  females  than  males  attending  aftercare 
at  6  months  to  8.4ft  more  females  than  males  attending  aftercare  at  24 
months.  The  differences  across  the  gender  categories  were  small  when 
compared  to  differences  across  the  categories  of  aftercare  attendance. 
Regardless  of  gender,  the  majority  of  the  subjects  never  attended  aftercare. 

Gender  differences  In  terms  of  treatment  utilization  are  well  known 
(Schucklt,  1985,  p.  104).  Compared  with  males,  females  have  higher 
utilization  rates  of  outpatient  services.5  As  noted  above,  it  might  be 
hypothesized  that,  as  treatment  for  alcoholism  becomes  more  accepted  in 
the  mainstream  population,  the  utilization  of  chemical  dependency  aftercare 
services  will  increasingly  resemble  the  utilization  rates  of  other  types  of 
health  care  services.  Parenthetically  it  was  noted  that  although  not 
reaching  the  level  of  statistical  significance,  the  AA  attendance  data  also 
showed  a  similar  pattern.  At  each  follow-up  Interview,  more  females  than 
males  reported  attending  AA  (see  Table  27).5 

The  relationship  between  type  of  substance  and  aftercare  was 
statistically  significant  across  the  time  frame  of  the  study,  but  yielded 
only  small  measures  of  association.  Table  28  shows  that  the  relatively 
small  group  of  "drug  abuse  only"  subjects  (N  =  201 )  reported  higher  rates  of 
aftercare  attendance  than  either  the  “alcohol  only"  group  or  the  "alcohol 
mixed  with  drugs"  group.  Schucklt  ( 1 979)  reported  that  drug  abusers  are 
often  under  legal  mandate  to  attend  aftercare  programs,  while  Westermeyer 

5  In  contrast,  males  have  higher  utilization  of  inpatient  services  than  femsles  t  Kincannon, 

1 987,  in  a  classroom  discussion,  Public  Health  5047:  Intervention/Secondary  Prevention  of 
Drug  Abuse  In  Adults,  Spring  Quarter,  1987).  Overall,  males  have  much  lower  medical  care 
utilization  rates  than  females.  (Jones  and  Vischi,  1979,  p.  13). 

6  Alford  ( 1 980)  also  found  that  mor  e  females  than  males  attended  AA  meetings  ( p.  366). 
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(1986)  noted  that  drugs  used  In  the  treatment  of  opiate  addiction  are 
available  only  through  licensed  clinics.  Both  points  suggested  that  there 
may  have  been  “external  agents"  serving  to  motivate  higher  levels  of 
aftercare  attendance  for  the  “drug  abuse  only"  group. 

The  statistical  relationship  between  years  of  education  and  aftercare 
attendance  was  not  easily  explained  (see  Table  30).  Several  hypotheses 
suggest  themselves  as  possible  explanations  for  this  finding.  First, 
subjects  with  higher  levels  of  education  were  possibly  better  disciplined 
and  motivationally  more  Inclined  to  remain  in  treatment.  Second,  as 
previously  discussed,  it  has  been  hypothesized  that  upper-middle  class, 
well-educated  persons  tend  to  utilize  mental  health  services  rather  than 
self-help  groups.7  It  may  well  have  been  that  the  subjects  with  more  years 
of  education  were  not  attending  aftercare  at  the  18-month  and  24-month 
follow-up  interviews,  but  were  involved  in  some  type  of  long-term  mental 
health  counseling.  Given  the  limitations  previously  discussed  with  the 
primary  data  source,  It  was  not  possible  to  explore  this  area  in  more 
detail.8 

For  the  sake  of  discussion,  if  it  is  assumed  that  most  subjects,  upon 
completion  of  their  inpatient  chemical  dependency  treatment,  were  referred 
to  both  AA  and  aftercare  services,  what  was  occurring  to  create  the 
differential  impact  of  the  control  variables  on  the  test  variables?  Only 
education  was  positively  correlated  with  both  test  variables.  Although 
relatively  weak  correlations,  these  findings  suggest  that  different 
dynamics  may  be  operating  In  terms  of  AA  attendance  and  aftercare 


7  See  earlier  cite  for  Knight  et  al.  ( 1980,  p.  60) 

8  As  previously  discussed,  aftercare  was  confounded  with  mental  health  treatment  In  the 
wordingoftheCATOR-lll  item, 


attendance.  While  puzzling,  this  differential  impact  of  the  control  variables 
upon  the  test  variables,  does  indirectly  suggest  that,  in  contrast  to  what 
will  be  presented  below,  attending  aftercare  may  yet  play  a  role,  albeit 
small,  In  determining  outcome. 

Question  3:  Were  there  significant  relationships  between 
the  control  variables  and  the  one  outcome  variable  (sobriety)  for 
which  a  significant  relationship  with  the  test  variables  was 
demonstrated? 

Null  Hypotheses:  For  each  time  period,  there  were  no 
relationships  between  sobriety  and  each  of  the  eight  control 
variables. 

Table  51  shows  that  It  was  possible  to  reject  a  number  of  the  null 
hypotheses  as  there  was  substantially  more  Interaction  between  the  control 
variables  and  sobriety  than  between  the  control  variables  and  either  of  the 
test  variables.  As  can  be  observed  in  Tables  34  through  Table  37,  the 
interaction  between  sobriety  and  the  control  variables,  was,  for  the  most 
part,  fairly  constant  across  the  two  year  time  span  of  this  study.  With  the 
exception  of  the  relationship  between  sobriety  and  age,  the  measures  of 
association  between  sobriety  and  the  remaining  control  variables  tended  to 
be  small. 


No  Relationship  between  Null  Hypothesis  Rejected? 

MzM 


8  moollis 

12  months 

18  months 

24  months 

1.  Age 

Yes 

Yes 

Yes 

Yes 

2.  Gender 

No 

No 

? 

No 

3.  Marital  Status 

Yes 

? 

Yes 

Yes 

4.  Ethnicity 

No 

No 

No 

No 

5.  Employability 

No 

No 

No 

No 

6.  Previous  CD  Tx 

Yes 

Yes 

Yes 

No 

7.  Type  of  Substance 

Yes 

? 

Yes 

? 

8.  Education 

No 

Yes 

No 

No 

( No  =  unable  to  reject  null  hypothesis  at  o  =  0.0 1 ) 

( ?  =  equivocal-  a  *  0.0 1 ,  but  +  or  Cramer's  V  <  0. 1 0) 

(Yes  *  able  to  reject  null  hypothesis  at  0.0 1  and  t  or  Cramer’s  V  i  0. 1 0) 


The  strongest  relationship  between  sobriety  and  the  control  variables 
observed  in  this  study  was  with  age.  Table  34  shows  that  at  6  months, 

67.  l  %  of  the  "under  30"  subjects  were  sober  as  compared  with  80.  l  %  of  the 
subjects  "over  30."  This  pattern  was  fairly  constant  across  the  study  so 
that  at  24  months,  68.8%  of  the  "under  30”  subjects  were  sober  as  compared 
with  78.7%  of  the  "over  30"  subjects.  These  findings  are  consistent  with 
the  literature  in  which  age  and  sobriety  have  been  shown  to  be  significantly 
related.  Younger  subjects  have  more  difficulty  remaining  chemically  free 
than  do  older  subjects  (Mendelson  and  Mello,  1979;  Schuckit,  1985;  and 
Bowen,  1987). 
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Previous  admissions  for  chemical  dependency  treatment  were 
significantly  related  to  sobriety,  although  Table  35  shows  that  the  majority 
of  the  relationship  was  more  concerned  with  the  choice  of  sobriety 
categories  than  the  number  of  previous  admissions.  The  Impact  of  previous 
admissions  on  the  subjects'  reports  of  sobriety  was  not  as  large  in  this 
study  as  was  anticipated  from  other  reports  in  the  literature.9  At  six 
months,  78%  of  the  subjects  who  reported  no  previous  admissions  were 
sober  compared  with  71.5%  of  the  clients  who  had  been  previously  admitted. 
By  24  months  the  percent  of  sober  subjects  who  reported  no  previous 
admissions  had  declined  slightly  to  76.9%,  while  the  percent  of  sober 
subjects  who  had  previous  admissions  actually  increased  to  73.1%. 

Marital  status  was  significantly  related  to  sobriety  across  the  two 
year  follow-up  period.  Table  37  shows  that  subjects  who  reported  their 
marital  status  as  single  were  less  likely  to  report  successfully  remaining 
abstinent.  For  the  remainder  of  the  subjects,  whether  they  were  married, 
divorced,  separated,  or  widowed  did  not  make  an  appreciable  difference. 
Although  not  addressed  in  the  data  analysis,  it  was  likely  that  the  quality  of 
"singleness"  in  relationships  also  Interacted  substantially  with  age  and  type 
of  substance.  Young,  single,  subjects  who  reported  drug  abuse  would  likely 
have  had  a  substantially  less  optimistic  prognosis.10  Gibbs  and  Flanagan 


9  Kolb  et  al.  ( 1 978),  Ornstein  and  Cherepon  ( 1 985),  Schuckit,  et  a).  ( 1 986)  all  found  the 
number  of  previous  hospitalizations  for  alcohol  problems  to  be  a  significant  predictor  of  outcome 
functioning. 

10  Interaction  among  the  control  variables  was  not  addressed  In  this  design,  as  the  control 
variables  were  not  the  direct  subject  of  Inquiry.  When  age  was  entered  into  the  multiple 
regression  equations,  marital  status  and  type  of  substance  were  excluded,  which  supported  the 
hypothesis  about  the  possibility  of  significant  interaction  among  age,  type  of  substance  and  marital 
status.  An  alternative  research  strategy  could  have  explored  the  relationships  between  these 
variables  and  sobriety  using  analysis  of  covariance,  controlling  for  age,  etc. 


(1977)  noted  that  nine  of  the  ten  studies  which  looked  at  marital  status 
found  It  to  be  a  predictor  of  successful  outcome  (p.  1131). 

Type  of  substance,  gender,  and  previous  admission  for  chemical 
dependency  treatment  weakly  interacted  with  both  the  test  variables  and 
sobriety,  as  an  outcome  variable.  Age  and  marital  status  were  correlated 
only  with  sobriety,  while  education,  for  the  most  part,  was  correlated  only 
with  the  test  variables.  Overall,  the  effect  of  the  control  variables  upon 
either  the  test  variables  or  the  outcome  variable  was  minimal. 

One  conclusion  that  can  be  drawn  from  these  findings  is  that,  for  the 
subjects  involved  In  this  sample,  either  the  test  variables  and  outcome 
variable  operated  fairly  independently  from  other  mediating  factors,  or,  as 
suspected  by  the  author,  there  were  other,  more  significant  mediating 
variables  Involved  with  this  sample  which  were  not  addressed  by  the 
literature  and  not  identified  In  this  study. 
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Question  4:  Was  there  a  significant  relationship  between 
AA  attendance  and  the  outcome  variables? 

Null  Hypotheses:  For  each  time  period,  there  was  no 
relationship  between  attending  AA  and  each  of  the  eleven 
outcome  variables. 


No  Relationship  between 


6  months 


1.  Full-time  Employment 

No 

No 

No 

No 

2.  Part-time  Employment 

No 

No 

No 

No 

3.  Welfare  Assistance 

No 

No 

No 

No 

4.  Disability  Assistance 

No 

No 

No 

No 

5.  Hospitalized-  Medical 

No 

No 

No 

No 

6.  ER  Visits 

No 

No 

No 

No 

7.  Injuries 

No 

? 

No 

No 

8.  Hospitalized-  Emotional 

No 

No 

No 

No 

9.  Misdemeanors 

No 

No 

No 

No 

10.  Felonies 

No 

No 

No 

No 

1 1 .  Sobriety 

Yes 

Yes 

Yes 

Yes 

( No  =  unable  to  reject  null  hypothesis  at  o  =  0.0 1 ) 

(?  =  equivocal- a  =  0.01,  but  R2  <  0.01) 

(Yes  =  able  to  reject  null  hypothesis  at  0.01  and  R2  i  0.0 1 ) 
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n.r 


iW 


warn 
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As  can  be  seen  in  Table  52,  for  ten  of  the  eleven  outcome  variables 
the  null  hypotheses  of  no  relationship  with  AA  attendance  could  not  be 
rejected.  Only  sobriety  produced  a  statistically  significant  relationship 
with  AA  attendance.  Certainly  AA  makes  no  promises  to  their  membership 
beyond  helping  alcoholics  to  stop  drinking. 1 1  However,  the  absence  of 
significant  relationships  between  AA  attendance  and  most  of  the  outcome 
variables  should  not  be  misconstrued  to  mean  that  attending  AA  should  be 
relegated  to  a  catch-all  for  ineffective  efforts. 

The  apparent  absence  of  a  relationship  between  AA  attendance  and  the 
outcome  variables  can  be  addressed  on  two  levels.  First,  there  were 
contextual  issues  which  serve  to  minimize  the  possibility  of  finding  a 
relationship  between  AA  attendance  and  the  outcome  variables  Second,  and 
more  important,  the  absence  of  a  relationship  between  AA  attendance  and 
the  majority  of  the  outcome  variables  calls  Into  question  the  adequacy  of 
the  model  which  generated  this  study.  A  discussion  of  the  adequacy  of  the 
model  will  be  deferred  until  later  In  this  chapter.  As  a  question  for  further 
study,  an  alternative  research  hypothesis  suggested  by  these  results  will  be 
presented  In  the  next  chapter. 

The  absence  of  a  significant  relationship  between  the  employment 
variables  and  AA  attendance  may  well  be  a  function  of  sample  selection.  As 
has  been  previously  discussed,  the  study  sample  was  composed  of  a  group  of 
relatively  high  functioning  subjects.  Table  5  shows  that  only  \4%  of  the 
sample  described  themselves  as  unemployed  at  the  time  of  admission  to 
treatment.  Consequently,  looking  for  a  relationship  between  AA  attendance 


ii  It  Is  Interesting  to  note  that  AA’s  charter  does  not  promise  to  improve  employment  status, 
marital  functioning  or  health,  etc.  M's  agenda  focuses  entirely  on  behaviors,  feelings  and 
attitudes  as  they  relate  to  supporting  the  clients'  desires  to  not  drink. 


and  employment  as  an  outcome  measure  when  the  majority  of  subjects  are 
already  employed,  would  not  produce  significant  results  unless  there  was  a 
dramatic  improvement  In  the  unemployed  category  vis-a-vis  the  employed 
category12 

One  of  the  benefits  associated  with  inpatient  treatment  for 
alcoholism  is  the  reduction  in  health  care  costs  following  treatment  (Jones 
and  Vischi,  1979).  Current  medical  and  psychological  problems  are 
stabilized  if  not  resolved,  and  future  problems  are  postponed,  if  not 
prevented.  Consequently,  even  under  the  most  adverse  situations,  at  the 
group  level,  a  substantial  amount  of  time  would  have  to  pass  before  changes 
in  the  group's  health  status  would  begin  to  occur.  For  this  reason  the  time 
frame  of  the  study  may  have  been  too  short  to  document  an  effect  between 
AA  attendance  and  the  development  or  reduction  of  further  health  problems. 

The  final  methodological  explanation  for  the  absence  of  an  observed 
relationship  between  AA  attendance  and  the  outcome  variables  may  have 
been  related  to  the  relative  infrequency  with  which  a  number  of  the  outcome 
events  occurred.  For  example,  among  the  2950  subjects  at  6  months,  there 
were  only  49  reports  of  misdemeanors,  and  4  reports  of  felonies  related  to 
chemical  use.  The  numbers  of  events  was  so  small,  that  a  much  larger 
sample  would  have  been  necessary  to  adequately  explicate  the  relationship 
between  AA  attendance  and  these  relatively  rare  events.13 


12  An  alternative  approach  to  looking  at  employment  as  an  outcome  variable,  would  have  been  to 
attempt  to  look  at  changes  In  employment  status  over  time  and  their  relationship  to  AA  attendance. 
Changes  In  employment  status  might  have  functioned  as  a  more  sensitive  measure  of  employment. 

13  The  relationship  between  legal  problems  and  AA  attendance  Is  often  complex.  In  many 
Instances  subjects  arrested  for  alcohol  related  offenses  will  go  to  AA  In  an  attempt  to  Influence 
legal  outcomes,  or  may  be  directed  to  AA  as  part  of  a  mandated  rehabilitation  regimen  ( Moore  and 
Gerstein,  1981;  Cahalan,  1987). 
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Table  38  shows  that  for  this  sample,  there  was  a  strong  relationship 
between  AA  attendance  and  sobriety  which  was  clearly  demonstrated  across 
the  two  year  time  frame  of  this  study,  Subjects  who  attended  AA  either 
several  times  a  month  or  weekly  exhibited  sobriety  rates  that  ranged  from 
16.7%  to  22.4%  higher  than  the  subjects  who  did  not  attend  AA  or  only 
attended  AA  on  a  sporadic  basis.  Furthermore,  the  graph  shows  that 
subjects  who  attended  AA  experienced  steady  Improvement  In  their  sobriety 
rates  over  the  two  years'  follow-up. 

Subjects  who  did  not  attend  AA  experienced  an  Initial  decline  in  their 
sobriety  rates  between  6-months  and  12-months.'4  it  Is  interesting  to 
note,  however,  that  in  the  second  year  of  follow-up  that  both  the  AA 
attenders  and  the  non-attenders  experienced  improvement  in  their  sobriety 
rates.  The  slopes  of  both  lines  are  equivalent.  While  both  groups  were 
maintaining  steady  improvement  in  their  sobriety  rates,  there  were 
substantial  changes  in  the  size  of  the  groups  within  their  respective 
categories.  The  number  of  non-attenders  were  Increasing  from  35  4%  of  the 
at  6  months  to  51.8%  of  the  sample  at  24  months, while  the  number  of  AA 
attenders  decreased  from  64.6%  of  the  sample  at  6  months  to  48.2%  of  the 
sample  at  24  months. 

This  point  Is  further  underscored  In  Table  41  which  shows  that  in  this 
sample,  while  the  sobriety  rate  remained  relatively  constant  (ranging  from 
740%  to  75.9%  )  over  the  two  year  period,  AA  attendance  decreased  in  each 
of  the  follow-up  periods.  These  findings  would  suggest  that  while  aa 
attendance  is  related  to  sobriety,  there  are  other  factors  which  influenced 

14  Kruzlch  ( 1 980)  noted  that  the  majority  of  treatment  failures  occur  within  the  first  months 
following  discharge  from  treatment. 


sobriety.  As  will  be  discussed  in  more  detail,  the  other  factors  influencing 
sobriety  for  this  sample  remain  for  the  most  part  unknown  to  date.  ’5 


Table  53  shows  that,  as  In  the  case  of  AA  attendance,  there  was  little 
indication,  with  the  obvious  exception  of  sobriety,  that  aftercare  was 
related  to  any  of  the  remaining  outcome  measures.  In  general,  the  earlier 
discussion  regarding  the  absence  of  substantial  relationships  between  the 
control  variables  and  AA  attendance  is  applicable  to  a  discussion  of 
aftercare  and,  in  the  interests  of  controlling  redundancy  will  not  be 
repeated  here. 

What  was  interesting  to  note  was  that,  unlike  AA  attendance, 
aftercare  had  a  number  of  very  small,  but  statistically  significant 
correlations  with  outcome  variables.  Part-time  employment,  welfare 
assistance,  and  hospitalization  for  emotional  problems  were  positively 
correlated  with  aftercare  at  one  or  more  time  intervals  (see  Table  32). 


15  Cronklte  and  Moos  ( 1 980)  suspect  that  posttreatment  experiences  such  as  "family 
environment,  stressful  life  events,  and  coping  responses  may  explain  70-  90$  of  the  variance  in 
treatment  outcome'*  (p.  305). 
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Their  measures  of  the  magnitude  of  association,  however,  were  so  small  as 
to  make  these  correlations  meaningless. 


No  Relationship  between 


6  months  12  .months  1 8  months  24  months 


1.  Full-time  Employment 

No 

No 

No 

No 

2.  Part-time  Employment 

? 

No 

? 

No 

3.  Welfare  Assistance 

NO 

No 

? 

No 

4.  Disability  Assistance 

No 

No 

No 

No 

5.  Hospitalized- Medical 

NO 

No 

No 

No 

6.  ER  Visits 

NO 

No 

No 

No 

7.  Injuries 

No 

No 

No 

No 

8.  Hospitalized-  Emotional 

No 

No 

No 

? 

9.  Misdemeanors 

No 

No 

No 

No 

10.  Felonies 

No 

No 

No 

No 

1 1 .  Sobriety 

Yes 

Yes 

? 

? 

( No  -  unable  to  reject  null  hypothesis  at  a  =  0.0 1 ) 

(?  =  equivocal- a  =  0.01,  but  R2  <0,01) 

( Ves  =  able  to  reject  null  hypothesis  at  0.0 1  and  R2  *  0.0 1 ) 


Comparing  Tables  31  with  Table  32,  the  difference  in  the  overall 
pattern  of  relationships  between  the  respective  test  variables  and  the 
outcome  variables  was  striking.  With  the  exception  of  sobriety,  AA 
attendance  was  clearly  unrelated  to  the  outcome  variables.  Aftercare,  on 
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the  other  hand,  appeared  to  be  slightly  related  to  a  number  of  the  outcome 
variables,  although  the  relationships  were  admittedly  very  weak.  One 
possible  explanation  for  this  difference  would  be  to  suggest  that  aftercare, 
rather  than  being  a  total  duplication  of  AA  efforts,  might  be  addressing 
Issues  other  than  sobriety  which  have  more  of  a  direct  impact  on  outcome. 

Tables  19  and  Table  20  show  that  the  percent  of  the  sample  attending 
aftercare  markedly  decreased  from  43. 1%  of  the  sample  at  6  months  to 
26.8%  at  12  months,  in  the  second  year  of  follow-up  the  pattern  continued 
so  that  by  24  months  only  17.2%  of  the  sample  were  attending  aftercare. 

The  relationship  between  AA  and  aftercare  becomes  evident  when  it  was 
noted  that  80.5%  of  the  subjects  attending  aftercare  at  6  months  were  also 
attending  AA,  compared  to  73.8  percent  at  24  months.  Aftercare  markedly 
reinforces  AA  attendance,  so  much  so  that  only  8.3%  of  the  sample  attended 
aftercare  only,  which  decreased  to  4.5%  at  24  months. 

What  is  Important  to  note  was  that  a  clear  majority  of  subjects 
(ranging  from  56.9%  at  6  months  to  82.8%  at  24  months)  did  not  attend 
aftercare.  When  they  did  attend,  It  was  for  short  periods  of  time,  clustered 
around  the  point  of  discharge  from  Inpatient  treatment.16  in  noticeable 
contrast,  the  interviews  conducted  with  the  aftercare  coordinators 
suggested  that  their  expectations  were  that  it  would  be  beneficial  for  the 
subjects  to  attend  aftercare  through  at  least  through  the  first  year,  and  in 
several  instances  through  the  second  year.17 


16  Osslp-Kleln  et  al.  ( 1 984)  also  noted  the  high  attrition  rate  among  aftercare  participants 
(p.  85). 

17  On  the  other  hand,  an  alternative  argument  can  be  made  that  as  short-term  transition 
programs,  established  for  sole  purpose  of  returning  the  client  to  his  community,  attendance  in 
aftercare  programs  should  be  short  term ,  so  that  one  would  not  expect  to  see  significant  numbers 
of  subjects  attending  aftercare  beyond  the  first  six-  twelve  months  posthospital ization. 
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Table  39  shows  the  relationship  between  aftercare  and  sobriety.  On 
the  surface  it  would  appear  that,  although  not  as  stable  as  AA  attendance, 
aftercare  attendance  resulted  in  an  increase  In  the  sobriety  rates  when 
compared  with  subjects  who  did  not  attend  aftercare.  Examining  the 
measures  of  association  ($)  It  was  clear  that  the  effect  of  aftercare  on 
sobriety  was  small  during  the  first  year  and  ceased  to  be  significant  in  the 
second  year.18  In  the  second  year  aftercare  accounted  for  only  an 
inconsequential  amount  (ranging  from  0.3%  at  18  months  to  0.6%  at  24 
months)  of  the  variance  In  sobriety. 

As  previously  discussed,  Interviews  were  conducted  with  15 
coordinators  of  aftercare  programs  in  an  effort  to  improve  the  val'dlty  of 
aftercare  as  a  construct.  All  coordinators  Interviewed  indicated  their 
programs  reinforced  subjects  attending  AA.  Consequently  it  was  expected 
that  there  would  be  a  substantial  amount  of  Interaction  between  aftercare 
and  AA  attendance.  Table  40  considered  the  possible  interaction  by  looking 
at  the  relationship  between  aftercare  and  sobriety  controlling  for  the  effect 
of  AA  attendance. 

The  measure  of  the  magnitude  of  association  between  aftercare  and 
sobriety,  taking  into  account  AA  attendance,  was  so  small  as  to  make 
Interpretation  of  the  relationship  meaningless,  Aftercare  did  not  account 
for  at  least  one  percent  of  the  variance  in  sobriety  when  the  effect  of  AA 
attendance  was  controlled.  For  subjects  who  attended  AA  there  were  no 
consistent  patterns  In  their  aftercare  attendance  across  the  two  years.  For 
subjects  who  did  not  attend  AA,  their  aftercare  attendance  was 


18  See  earlier  discussion  regarding  decision  rules  to  reduce  the  possibility  of  accepting  a 
spurious  relationship  as  real  by  setting  the  o  =  0.01  andther2  ($2)  =  o.O  t . 


statistically  significant  during  the  first  year  but  accounted  for  less  than 
one  percent  of  the  variance  In  sobriety. 

As  discussed  earlier,  aftercare  as  a  construct  was  compromised  in 
terms  of  content  validity.  Efforts  to  improve  the  construct  by  creating  a 
measure  of  intensity  of  aftercare  did  not  result  in  substantially  different 
results  (see  Table  42).  Both  predictor  variables  ("aftercare  attendance"  and 
“Intensity  of  aftercare")  resulted  in  significant  chi  square  tests  in  the  first 
follow-up  period.  In  both  Instances,  the  measures  of  association  were  very 
small  and  inconsequential,  even  when  the  relationships  were  statistically 
significant. 

Regardless  of  which  construct  was  used,  the  effect  of  aftercare  did 
not  extend  beyond  the  first  year  and  explained  such  a  small  portion  of  the 
variance  in  sobriety,  that  the  statistical  relationship  had  no  meaning.  These 
findings  were  consistent  with  Ahles  et  al.  (1983)  who  also  found  a  small 
correlation  between  aftercare  and  abstinence.  "Analyses  which  looked  at 
aftercare  and  areas  other  than  abstinence  failed  to  reach  an  acceptable 
level  of  significance"  (p.  57).  In  contrast  to  Walker  et  al.  (1983)  the  higher 
intensity  of  aftercare  was  not  correlated  with  improved  outcome 
functioning. 

Question  6;  Does  cross-lagged  panel  analysis  enhance 
our  understanding  or  the  correlations  between  the  test 
variables  and  sobriety? 

Null  Hypotheses:  For  each  comparison  of  time 
periods  (6-months  with  12-months,  etc),  there  were  no 
differences  between  the  two  cross-lagged 


correlations,  connecting  the  test  variables  with 
sobriety. 
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Null  Hypotheses:  For  each  comparison  of  time 
periods  (6-months  with  12-months,  etc),  the 
synchronous  correlation  between  the  test  variables 
and  sobriety  was  spurious,  due  to  the  independent 
influence  of  a  third  (unknown)  variable. 


Table  54;  Results  of  the  Data  Analysis  in  Terms  of  the 
Null  Hypotheses  Regarding  the  Cross-Lagged  Panel  Analyses  of 
I,p£.I.e.sLy..aclaDles  and  SoMfcty 

Null  Hypothesis  Rejected? 

Null  HYUQthesiS;  $fW-12  W  12fll0i-lg.m  1 8  mo-24  mo 

^Attendance  and  sobriety; 


1 .  Spurious  Relationship? 

No 

Yes 

Yes 

2.  Cross- Lag  Correlations 
Equivalent? 

No 

Yes 

Yes 

Aftercare  and  sobriety: 

1 .  Spurious  Relationship? 

No 

? 

No 

2.  Cross-Lag  Correlations 
Equivalent? 

No 

? 

No 

( No  =  unable  to  reject  null  hypothesis  at  a  =  0.0 1 ) 

(?■  equivocal- a  =  0.01,  but  R2  <  0.01) 

(Yes  =  able  to  reject  null  hypothesis  at  0.0 1  and  R2  i  0.0 1 ) 
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The  cross-lagged  panel  analysis  between  AA  attendance  and  sobriety 
(Table  54)  supported  for  the  most  part  the  hypotheses  that  the  relationships 
between  AA  attendance  and  sobriety  were  real  rather  than  spurious,  and 
suggested  that  the  diagonal  relationships  (AA  at  time  1  by  sobriety  at  time 
2,  etc.)  of  AA  attendance  contributing  to  sobriety  were  more  relevant  than 
the  reverse  situation.  The  results  of  the  cross-lagged  panel  analysis 
between  aftercare  and  sobriety  were  Inconclusive.  The  effects  of  a  third 
variable  causing  the  appearance  of  a  spurious  relationship  could  not  be  ruled 
out.  The  comparisons  of  the  diagonal  relationships  were  not  significant. 

The  relationships  In  Table  43  between  AA  attendance  and  sobriety 
were  consistent  across  time  and  stable,  In  that  there  was  little  change  in 
the  size  of  correlations  from  one  time  period  to  the  next.  The  relatively 
small  size  of  the  synchronous  correlations  and  cross-lagged  correlations, 
suggested  caution  regarding  any  Inference  about  relationships  between  the 
variables.  As  has  previously  been  discussed,  other  factors,  although 
unknown,  apparently  contributed  to  the  variance  In  sobriety.  Consequently, 
even  though  the  cross-lagged  panel  analysis  of  the  relationship  between  AA 
attendance  and  sobriety  was  statistically  significant,  the  other  unknown 
factors  may  have  been  more  Instrumental  in  influencing  sober  outcomes. 

Closer  examination  of  the  cross-lagged  correlations  suggested  that, 
although  two  of  the  three  comparisons  between  time  periods  were 
statistically  significant,  the  Influence  of  sobriety  on  subsequent  AA 
attendance  was  not  ruled  out.  The  data  suggested  that  while  AA  attendance 
was  more  of  an  influence  on  sobriety  than  the  reverse  situation,  the  data 
suggested  sobriety  may  also  have  influenced  subsequent  AA  attendance.  In 
other  words,  while  cross-lagged  panel  analysis  ruled  out  the  possibility  of  a 
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spurious  relationship  between  the  two  variables,  the  relatively  small 
difference  in  size  between  the  cross-lagged  correlations  in  each  time 
period  suggested  that  both  variables  influenced  each  other,  but  that  the 
influence  of  AA  attendance  on  sobriety  is  slightly  stronger  than  the  reverse 
situation. 

Although  essentially  producing  negative  results,  the  cross-lagged 
panel  analysis  between  aftercare  and  sobriety  was  more  interesting  in 
terms  of  outcome  (see  Table  44).  As  noted  above,  only  one  of  the  three 
comparisons  between  time  periods  (12-18  months)  was  statistical ly 
significant.  As  the  cross-lagged  correlation  between  1 2-months  and  1 8- 
months  resulted  in  an  1 8-month  synchronous  correlation  which  was 
essentially  meaningless  (the  predictor  variable  only  explained  0.4%  of  the 
variance  in  the  outcome  variable).  For  practical  purposes,  it  was  concluded 
that  the  cross-lagged  panel  analysis  did  not  demonstrate  a  relationship 
between  aftercare  and  sobriety. 

Thus  cross-lagged  panel  analysis  was  not  able  to  rule  out  the 
possibility  that  the  apparent  relationship  between  aftercare  and  sobriety 
may  have  been  spurious,  the  result  of  the  Influence  of  a  third  variable  on 
both  aftercare  and  sobriety.  Given  the  previously  discussed  contribution  of 
AA  attendance  vis-a-vis  aftercare  to  sobriety,  we  have  some  idea  what  that 
third  variable  may  have  been.  For  this  sample,  the  data  cannot  rule  out  a 
hypothesis  that  the  relationship  between  aftercare  and  sobriety  may  be  the 
spurious  result  of  the  relationship  between  AA  attendance  and  sobriety  and 
AA  attendance  and  aftercare. 


Question  7:  Do  the  test  variables  Improve  our  understanding 
of  the  variance  In  sobriety  over  and  above  the  variance 
already  explained  by  the  control  variables? 


Null  Hypotheses:  For  each  time  period,  AA  attendance 
did  not  add  to  the  understanding  of  the  variance  In  the 
outcome  variables  when  the  control  variables  were  entered 
first  Into  a  multiple  regression  equation. 

Null  Hypotheses:  For  each  time  period,  aftercare 
attendance  did  not  add  to  the  understanding  of  the  variance 
In  the  outcome  variables  when  the  control  variables  and  AA 
attendance  were  entered  first  into  a  multiple  regression 
equation. 


Table  55  reveals  that,  while  the  null  hypotheses  regarding  AA 
attendance  can  be  easily  rejected,  the  same  cannot  be  said  about  rejecting 
the  null  hypotheses  regarding  aftercare  attendance.  Both  methods  (stepwise 
and  block  entry  )  of  entering  the  test  variables  Into  the  multiple  regression 
equation  resulted  in,  at  best,  ambiguous  results  about  the  relationship 
between  aftercare  attendance  and  sobriety. 

Table  45  shows  that  in  a  stepwise  multiple  regression  of  soDnety  in 
which  the  eight  control  variables  and  two  test  variables  were  entered  on 
the  basis  of  the  importance  of  their  contribution  to  the  explanation  of  the 
variance  in  the  outcome  variable,  AA  attendance  was  chosen  in  each  follow- 
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up  period  as  the  most  important  of  the  variables  considered  in  this  study. 
Across  the  two  year  time  frame  of  this  study,  AA  attendance  accounted  for 
only  a  small  portion  (ranging  from  5.6%  to  9.7%)  of  the  variance  in  sobriety. 
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1.  AA  attendance  did  not 
add  to  the  explanation  of  the 
variance  in  sobriety  already 
provided  by  the  control 
variables? 


2.  Aftercare  attendance  did  not 
add  to  the  explanation  of  the 
variance  in  sobriety  already- 
provided  by  the  control 
variables  and  AA  attendance? 


( No  =  unable  to  reject  null  hypothesis  at  o  =  0.0 1 ) 

(?  =  equivocal- a  =  0.01,  but  R2  <0.01) 

( Yes  =  able  to  reject  null  hypothesis  at  0,01  andR2  *0.01) 


Aftercare  attendance  was  entered  into  the  multiple  regression 
equation  for  the  6-month  follow-up  interval,  only  after  two  control 
variables,  and  accounted  for  only  an  additional  0.5%  explanation  of  the 
variance  In  sobriety.  In  the  12-month  follow-up  data,  aftercare  improved 
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its  relative  position  In  terms  of  being  entered  into  the  equation,  but  still 
accounted  for  only  0.7%  increase  in  the  explanation  of  the  variance  in 
sobriety.  Aftercare  did  not  meet  the  minimum  criteria  to  be  selected  for 
either  the  18-month  follow-up  Interval  or  the  24-month  follow-up  interval. 

Age  was  the  most  important  control  variable  selected  in  a  stepwise 
multiple  regression  of  sobriety.  The  contribution  of  age  to  the  explanation 
of  variance  in  sobriety  was  low.  The  additional  explanatory  power  provided 
by  age  ranged  from  0.7%  to  1.3%  of  the  variance  in  sobriety.  The  other 
control  variables  selected  by  SPSS  for  entry  into  the  equation  each 
accounted  for  less  than  one  percent  of  the  variance  in  sobriety  and 
essentially  were  irrelevant. 

Considering  the  control  variables  as  a  group,  their  combined  Influence 
only  accounted  for  1.8%  to  3.2%  of  the  variance  In  sobriety,  depending  on 
which  follow-up  interval  was  being  examined  (see  Table  46).  After  taking 
the  control  variables  into  consideration,  AA  attendance  remained  the  most 
important  predictor  of  sobriety  outcome.  While  the  SPSS  protocol  found 
aftercare  to  be  statistically  eligible  to  be  entered  into  the  equation,  even 
after  taking  AA  attendance  into  consideration,  the  additional  contribution  of 
aftercare  to  the  explanation  of  the  variance  in  sobriety  was  negligible.19 

A  summary  of  the  multiple  regression  findings  suggested  that  AA 
attendance  contributed  to  our  understanding  of  sobriety,  over  and  above  the 
influence  of  a  number  of  control  variables.  A  cross-validation  of  the 
multiple  regression  equations  on  a  second  subset  of  data  replicated  these 

19  Forcing  the  control  variables  into  the  multiple  regression  equation  before  the  test  variables 
resulted  in  slightly  different  control  variables  being  selected.  The  specific  control  variables 
selected  have  very  little  relevance  as  their  combined  contribution  to  an  explanation  of  the  outcome 
variance  was  low.  The  total  R2change  for  the  control  variables  was  the  same  regardless  of  which 
method  of  entry  of  variables  was  chosen. 
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findings  which  gave  credence  to  their  validity  in  terms  of  having 
substantiated  a  relationship  between  the  test  variables  and  sobriety  (see 
Table  47).  The  specific  control  variables  were  chosen  because  of  their 
anticipated  Interaction  with  either  the  test  variables  or  the  outcome 
variables.  In  terms  of  their  relationship  with  sobriety,  the  control 
variables  added  very  little  to  our  understanding  of  sobriety.  That  the 
majority  of  the  variance  in  sobriety  was  unexplained,  suggested  that  the 
contribution  of  other  variables  remained  to  be  identified. 


Question  8:  How  effective  was  a  model  (Figure  1)  which 
explained  the  variance  In  sobriety  through  a  combination  of 
test  and  control  variables? 


Even  taking  into  consideration  the  effect  of  the  control  variables,  AA 
attendance  continued  to  be  significantly  related  to  sobriety  for  each  of  the 
follow-up  intervals.  It  was  noted  that  AA  attendance  accounted  for  only  a 
small  portion  of  the  variance  in  outcome.  The  majority  of  the  variance  in 
sobriety  remained  to  be  explained.  The  implication  of  this  finding  was 
further  clarified  through  the  use  of  discriminant  analysis  in  which  the 
sample  was  statistically  divided  into  two  groups  on  the  basis  of  their 
sobriety  outcome  categories  ("sober"  and  "not  sober").  The  discriminant 
function  (made  up  of  the  contribution  of  the  control  variables  and  test 
variables)  was  used  to  predict  sobriety  for  the  sample.  Their  predicted 
outcomes  were  then  compared  with  their  actual  outcomes. 
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Table  48  shows  that  the  hypothetical  model  (see  Figure  i )  which 
generated  this  study  did  improve  to  a  small  degree  the  chances  of  correctly 
predicting  subjects'  sobriety  outcomes.  With  no  additional  information,  the 
probability  of  correct  selection  would  have  been  maximized  by  random 
assignment  of  each  subject  on  the  basis  of  p.  =  0.50  to  either  "sober"  or  "not 
sober"  categories.  The  model  improved  the  chances  of  correct  selection 
from  12.8%  to  15.5%  over  the  anticipated  results  using  a  random  selection 
device. 

Table  48  demonstrates  that,  the  model,  as  conceptualized,  was  not 
very  effective.  Although  It  Improved  the  chances  of  correct  prediction, 
many  errors  were  still  made.  The  model  was  somewhat  more  accurate  in 
predicting  clients  who  were  not  sober  than  sober  clients.  The  average  error 
in  prediction  ranged  from  34.5%  to  37.2%.  The  discriminant  analysis  of  the 
data  supported  the  multiple  regression  findings.  AA  attendance  helped  to 
predict  sobriety.  The  combined  influence  of  the  control  variables  was  not 
very  large.  The  modest  efficacy  of  the  model  in  predicting  sobriety 
suggested  that  the  model  could  be  enhanced  through  further  exploration  of 
other,  as  yet  unknown,  factors  involved  in  sobriety. 


A  secondary  analysis  of  data  must  work  within  the  constraints 
imposed  by  the  primary  data  source.  This  issue  was  most  cogent  in 
discovering  the  "constructural  bridge”  between  the  author's  Interest  In 
exploring  AA  attendance  and  aftercare  in  relation  to  outcome,  and  the 
available  data  from  a  large  and  heterogeneous  sample,  in  particular,  the 
issue  became  one  of  establishing  the  connections  between  the  CATOR-m 
items  as  operational  definitions  and  their  respective  constitutive  meanings 
as  theoretical  constructs.  The  major  limitation  imposed  by  the  primary 
data  was  that  CATOR-Hl  only  asked  questions  about  subjects'  use  of  AA  and 
aftercare  in  terms  of  attendance. 

The  author  found  It  was  Important  to  take  care  not  to  attribute  more 
significance  to  the  findings  than  was  warranted.  For  example,  this  study 
looked  at  the  subject's  report  of  AA  attendance  which,  as  a  construct,  had 
rather  limited  meaning  in  terms  of  an  operational  definition.  AA  attendance 
could  not  be  construed  In  any  fashion  to  Imply  that  this  study  looked  at  the 
effectiveness  of  AA.  In  the  same  manner,  a  report  of  AA  attendance  does 
not  measure  the  degree  to  which  a  subject  attempted  to  resolve  his/her 
chemical  dependency  problem.  AA  attendance,  as  used  in  this  study,  did  not 
refer  to  an  Indirect  measure  of  a  subject’s  motivation. 

AA  attendance  and  aftercare  attendance,  however,  as  limited 
constructs,  were  important  variables  to  be  studied  in  their  own  right.  Both 
the  literature  review  and  the  interviews  with  the  aftercare  coordinators 
established  the  fact  that  clients  Involved  in  chemical  dependency  treatment 


are  expected  to  attend  AA  and  aftercare  as  part  of  their  posttreatment 
regimen.  Consequently  it  was  logical  to  ask  the  question  of  the  CATOR-m 
subjects  whether,  in  fact,  they  did  attend  these  programs,  and  whether  this 
attendance  was  related  to  measurable  outcome  results, 

A  second  problem  that  developed  during  the  planning  stages  of  this 
dissertation  involved  the  Issue  of  which  types  of  data  analytic  tools  would 
be  used  in  the  secondary  analysis.  Initially  a  decision  was  made  to  take 
advantage  of  the  interval  quality  of  much  of  the  data  and  use  analysis  of 
variance  to  explore  the  relationships  among  the  respective  variables.  Given 
the  relative  ambiguity  regarding  the  relationships  among  the  variables, 
early  on  It  became  evident  that  contingency  tables  provided  a  more 
descriptive  means  of  exploring  the  bivariate  relationships  among  the 
variables. 

The  visual  presentation  of  relationships  provided  by  the  contingency 
tables  more  than  compensated  for  the  problems  created  by  their  use  in 
terms  of  talking  about  the  magnitude  of  relationships  between  variables  and 
observing  the  effect  of  one  variable  upon  the  other.  As  was  demonstrated  by 
the  many  graphs  presenting  bivariate  comparisons,  the  measures  of 
association  for  nominal  data  (0or  Cramer's  V)  did  not  locate  the 
relationship  in  terms  of  the  effect  of  one  variable  upon  the  other.  The 
graphic  presentation,  however,  made  it  possible  to  augment  the  statistical 
finding  with  descriptive  explanation.20 

20  As  previously  noted.for  variables  which  were  both  nominal  and  dichotomous,  f2  =  r2,  which 
allowed  for  more  specific  discussion  of  the  relationship  between  two  variables.  The  issue  still 
remained  regarding  the  relative  "comfort  level"  required  in  making  assumptions  about  the 
function  of  a  specific  variable  as  an  independent  versus  dependent  variable. 
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In  this  regard  the  cross-lagged  panel  analysis  was  helpful,  at  least  on 
an  heuristic  level,  in  the  explication  of  bivariate  relationships,  it  was 
Important  to  observe  that  while  one  side  of  a  cross-lagged  panel  analysis 
may  have  predominated,  the  opposing  cross-lag  still  contributed  to  the 
relationship.  Consequently  the  cross-lagged  panel  analysis  added 
considerably  to  an  understanding  of  the  data  by  emphasizing  the  relative 
rather  than  absolute  nature  of  relationships.  The  difficulty  cross-lagged 
panel  analysis  brought  to  this  study  was  that,  as  a  data  analytic  tool,  it  was 
not  able  to  take  into  account  the  complexity  of  the  variables.  Bivariate 
explication  had  to  ignore  the  multldetermlned  nature  of  many  of  the 
variables.21  As  a  result  of  the  types  of  tools  chosen  for  this  study  the 
degree  to  which  relationships  could  be  explored  was  limited. 

In  terms  of  first  steps,  however,  the  findings  presented  in  this  study 
have  laid  the  groundwork  for  a  more  expansive  exploration  of  the  variables. 
Obvious  disparities  between  the  data  and  the  mooci  used  to  explore  the 
CATOR-1 1 1  data  have  suggested  that  In  its  simplicity,  the  model  was  not 
very  effective.  Utilizing  the  unanticipated  findings  in  this  data  analysis,  a 
model  will  be  suggested  in  the  next  chapter,  which,  in  combination  with 
other  data  analytic  tools  (e.g.,  path  analysis),  would  allow  for  further 
exploration  of  the  provisional  findings  described  In  this  study,  focusing  on 
the  multldetermlned  aspects  of  many  of  the  relationships  among  variables. 


21  These  limitations  regarding  bivariate  analyses  and  cross-lagged  panel  analyses  are  relevant, 
not  just  for  this  study,  but  in  general  terms  for  any  study  which  looks  at  social  relationships. 


OVERVIEW 


This  chapter  summarizes  the  study.  The  purpose,  methods  and 
findings  are  reviewed  in  the  first  section.  A  number  of  limitations 
regarding  the  generallzability  of  the  findings  are  next  presented.  The  third 
section  addresses  the  implications  of  this  study  for  the  chemical 
dependency  treatment  field  and  Implications  for  the  social  work  profession. 
As  part  of  the  final  section,  an  alternative  model  Is  presented  which  takes 
into  account  the  multidetermlned  nature  of  many  of  the  variables  considered 
In  this  study.  The  summary  chapter  concludes  with  a  brief  commentary 
regarding  the  necessity  of  dealing  with  the  Ideological  barriers  which  have 
had  a  limiting  influence  on  the  quality  of  research  in  the  chemical 
dependency  field 


SUMMARY  OF  STUDY 

With  rare  exceptions,  when  clients  complete  inpatient  chemical 
dependency  treatment,  they  are  encouraged  to  attend  both  aftercare  and  AA 
meetings.  This  study  looked  at  2,950  subjects  who  had  been  discharged 
from  treatment  between  January,  1 983  and  July,  1 985,  and,  who 
subsequently  agreed  to  participate  In  a  two  year  follow-up  registry. 
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Subjects  were  interviewed  every  six  months  about  a  broad  range  of 
subjects.  As  a  secondary  analysis  of  a  portion  of  this  data,  this  study 
looked  at  the  degree  to  which  subjects  attended  aftercare  and  AA,  and 
whether  their  attendance  of  these  supportive  services  was  correlated  with 
a  number  of  outcome  measures  which  were  suggestive  of  successful 
adaptation  to  their  chemical  dependency  problems. 

Based  on  a  review  of  the  literature,  a  model  was  developed  which 
served  to  guide  the  data  analysis.  Subjects'  performance  on  particular 
outcome  variables  were  conceptualized  as  the  result  of  the  interactions 
among  the  eight  control  variables,  reflecting  Important  subject 
characteristics,  and  whether  or  not  they  attended  aftercare  and  AA 
meetings.  Based  on  this  model,  eight  research  questions  and  hypotheses  to 
be  tested  were  generated  to  explore  the  relationships  between  AA 
attendance,  aftercare  attendance  and  the  control  and  outcome  variables. 

Following  a  short  description  of  the  demographic  features  of  this 
sample,  a  series  of  bivariate  comparisons  were  carried  out  to  assess  the 
Impact  of  the  control  variables  on  the  test  variables  and  the  one  outcome 
variable  (sobriety),  for  which  a  significant  correlation  with  the  test 
variables  was  established.  Cross-lagged  panel  analysis  was  used  to  rule 
out  the  possibility  of  spurious  relationships  between  the  two  test  variables 
(AA  attendance  and  aftercare  attendance)  and  sobriety.  The  relationships 
among  the  synchronous  correlations,  autocorrelations,  and  cross-lagged 
correlations  allowed  for  comments  regarding  directional  influence  between 
the  two  test  variables  and  the  one  outcome  variable. 

Multiple  regression  analysis  was  used  to  determine  the  relative 
contribution  of  the  test  variables  vis-a-vis  the  control  variables  In  the 
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explanation  of  the  variance  in  sobriety.  Without  identifying  the  independent 
variables  as  either  test  variables  or  control  variables,  the  independent 
variables  were  first  entered  in  a  stepwise  fashion  into  the  multiple 
regression  equation,  in  a  second  multiple  regression  analysis,  the  control 
variables  were  entered  as  a  block  and  allowed  to  explain  as  much  of  the 
variance  in  sobriety  as  possible.  Next  the  test  variables  were  entered  to 
see  what  was  their  contribution,  over  and  above  that  already  provided  by  the 
control  variables. 

For  the  purpose  of  cross-validation,  the  multiple  regression  analyses 
were  developed  on  one  subset  randomly  selected  from  the  study  sample.  A 
second  subset,  Independent  from  the  first,  was  randomly  selected  to 
observe  how  the  multiple  regression  equations  held  up  when  applied  to  a 
second  set  of  data.  In  the  final  step  of  the  multivariate  analysis, 
discriminant  analysis  was  used  to  comment  on  the  effectiveness  of  the 
theoretical  model  guiding  this  study  by  using  it  to  predict  the  sobriety 
outcomes  of  the  subjects  and  comparing  the  predicted  outcomes  with  the 
actual  outcomes. 

Overall  the  control  variables  played  a  relatively  minor  role  in  the 
results  of  this  study.  The  control  variables  were  found  to  be  essentially 
unrelated  to  AA  attendance,  only  weakly  related  to  aftercare  attendance, 
and  somewhat  more  related  to  sobriety.  When  entered  as  a  block  Into  a 
multiple  regression  equation,  considered  together,  the  control  variables 
only  accounted  for  a  small  portion  (from  1.8%  to  3.2%)  of  the  variance  In 
sobriety.  Age  was  the  only  control  variable  which  explained  at  least  one 
percent  of  the  variance  In  sobriety. 
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Of  the  eleven  outcome  variables,  only  sobriety  was  found  to  be 
significantly  correlated  with  both  AA  attendance  and  aftercare  attendance 
over  the  two  year  time  period.  In  addition  to  sobriety,  three  other  outcome 
variables  were  related  to  aftercare.  With  the  exception  of  sobriety,  the 
measures  of  association  between  the  other  three  outcome  variables  and 
aftercare  were  so  small  as  to  make  Interpretation  of  the  significant 
relationships  meaningless. 

The  strongest  correlations  In  this  study  were  between  AA  attendance 
and  sobriety.  Subjects  who  attended  AA  at  least  several  times  a  month 
showed  gradual  and  steady  Improvement  In  their  sobriety  rates  over  the  two 
year  period.  Although  statistically  significant  for  the  two  year  period, 
given  the  very  small  size  of  the  measures  of  association  it  was  difficult  to 
demonstrate  a  meaningful  relationship  between  aftercare  attendance  and 
sobriety  beyond  one  year.  Controlling  for  AA  attendance,  there  were  no 
significant  relationships  between  aftercare  and  sobriety. 

A  cross-lagged  panel  analysts  of  the  relationship  between  AA 
attendance  and  sobriety  supported  the  hypothesis  that  the  relationship 
between  the  two  variables  was  real  rather  than  the  spurious  result  of  the 
effects  of  a  third  variable.  Comparing  the  cross-lagged  correlations,  it  was 
evident  that,  while  AA  attendance  was  more  Important  In  determining 
sobriety  than  the  reverse  situation,  the  effects  of  sobriety  on  AA 
attendance  were  not  ruled  out. 

The  cross-lagged  panel  analysis  of  the  relationship  between  aftercare 
and  sobriety  produced  equivocal  results.  It  was  not  possible  to  rule  out  the 
possibility  that  the  apparent  relationship  between  aftercare  and  sobriety 
was  the  spurious  effect  of  a  third  variable  which  Independently  Interacted 
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with  both  aftercare  and  sobriety  to  give  the  appearance  of  a  relationship. 
The  earlier  bivariate  comparisons  suggested  that  AA  attendance  was 
probably  the  third  variable  which  was  related  to  both  aftercare  and 
sobriety.  An  examination  of  the  cross-lagged  correlations  did  not  allow  for 
comments  regarding  directional  differences  In  the  effects  of  one  variable 
upon  the  other. 

When  entered  in  a  stepwise  fashion  into  a  multiple  regression 
equation,  for  each  follow-up  interval  SPSS  chose  AA  attendance  first,  from 
among  the  other  Independent  variables,  for  Its  Importance  In  explaining  the 
variance  in  sobriety.  Aftercare  was  selected  for  only  the  6-month  and  12- 
month  follow-up  Intervals.  In  both  cases  the  additional  explanatory  power 
provided  by  aftercare  was  very  small.  In  the  second  multiple  regression 
analysis,  AA  attendance  continued  to  account  for  the  largest  portion  of  the 
explained  variance  in  sobriety,  even  after  all  of  the  control  variables  had 
been  taken  into  account.  Taking  Into  consideration  the  control  variables  and 
AA  attendance,  aftercare  was  statistically  significant  for  each  follow-up 
Interval  but  only  accounted  for  a  negligible  Increase  In  the  explanation  of 
the  variance  In  sobriety. 

The  adequacy  of  the  model  which  was  used  to  guide  this  study  can  be 
assessed  on  two  levels.  First,  the  multiple  regression  equations  which 
were  developed  on  one  subset  of  the  sample  were  cross-validated  on  a 
second  subset  of  data.  Comparing  the  absolute  differences  between  the 
Multiple  R  of  the  first  subset  with  the  cross-validation  r  of  the  second 
subset,  It  was  concluded  that  for  each  time  period,  the  model  did  explain  a 
portion  of  the  variance  In  sobriety  which  held  up  when  compared  with  a 
second  set  of  data. 


The  effectiveness  of  the  model,  however,  was  called  Into  question  by 
the  fact  that  the  test  variables  and  the  control  variables  only  accounted  for 
between  9.08  and  1 1.68  of  the  variance  In  sobriety.  The  majority  of  the 
variance  In  sobriety  was  unaccounted  for  by  this  model.  A  discriminant 
function  was  calculated  to  predict  sobriety  outcomes  which  were  then 
compared  with  the  actual  outcomes.  Use  of  this  model  for  predicting 
outcome  scores  resulted  In  a  12.88-  15.58  Improvement  In  prediction  rates 
over  what  would  have  been  obtained  through  randomly  assigning  subjects  to 
either  the  “sober"  or  “not  sober"  categories. 

The  results  of  the  data  analysis  showed  that  the  relative 
effectiveness  of  the  model  which  guided  the  data  analysis  was  certainly 
questionable.  The  large  percentage  of  variance  In  sobriety  remaining  to  be 
explained,  combined  with  an  average  predictive  error  rate,  which  ranged 
from  3458  to  37.28,  suggested  that  the  model  upon  which  this  study  was 
based  was  not  very  effective  and  should  be  revised.  The  individual  bivariate 
comparisons  provided  clues  as  to  how  this  revision  might  be  structured. 
Limitations  experienced  with  the  data  analytic  techniques  used  In  this  study 
suggested  an  alternative  approach  to  the  data  analysis.  Both  the  revised 
model  and  the  alternative  approach  to  the  analysis  of  the  data  will  be 
discussed  later  In  this  chapter. 


Hi 


211 


* 

txUfrXUfr, 


The  study  sample  was  drawn  from  a  population  which,  in  many 
respects,  was  more  representative  of  mainstream  America  than  the 
majority  of  studies  cited  in  the  literature  review.  Thus,  It  is  with  some 
irony,  that  It  must  also  be  noted  that  the  results  have  very  limited 
general izablllty  beyond  the  CATOR-1II  population.  The  focus  of  this  study, 
however,  was  on  the  relationships  among  variables  rather  than  in  the 
specific  characteristics  of  the  population  under  study.  It  was  hoped  that 
the  Increased  Information  provided  by  excluding  subjects  for  whom  less 
than  complete  data  were  available,  would  be  worth  the  reduction  in  ability 
of  the  findings  to  be  generalized  outside  of  the  CATOR-Ill  population. 

It  is  important  to  recognize  that  this  study  was  not  an  evaluation  of 
the  effectiveness  of  AA  or  aftercare.  Rather,  what  was  studied  was  the 
impact  of  the  recommendation  that  subjects  attend  one  or  both  of  the 
supportive  services.  A  correlation  between  AA  attendance  and  sobriety  does 
not  address  the  Issue  of  what  processes  were  occurring  to  produce  the 
observed  effect.  We  do  not  know  what  It  was  about  attending  AA,  for 
example,  that  was  particularly  relevant  for  the  maintenance  of  sobriety  in 
this  sample.  In  a  related  manner,  It  should  be  stressed  that  In  only  looking 
at  attendance,  other  relevant  aspects  of  both  test  variables  may  have  been 
missed  which  might  have  had  more  of  an  Impact  on  their  relationship  with 
outcome. 

A  third  limitation  to  this  study  relates  to  the  state  of  the  art  of 
alcoholism  treatment  as  It  was  being  practiced  when  these  subjects  were 


"socialized”  into  the  roles  of  becoming  recovering  alcoholics.  It  goes 
without  saying  that  good  Intentions  precede  effective  service  delivery.  This 
appears  to  be  particularly  relevant  for  the  alcoholism  treatment  field.  For 
example,  aftercare  In  the  early  1970s  differs  from  aftercare  In  the  early 
1980s,  and  will  probably  differ  from  what  will  be  provided  in  the  early 
1990s.  Contrasting  aftercare  as  practiced  in  the  1970s  with  aftercare  as 
practiced  In  the  mid-1980s  might  be  similar  to  comparing  apples  and 
oranges. 

At  the  time  these  subjects  went  through  treatment,  the  importance  of 
aftercare  was  being  touted,  without  a  clear  picture  as  to  what  types  of 
aftercare  services  might  be  relevant.  Consequently  care  must  be  taken 
when  comparing  aftercare  at  one  point  in  time,  where  It  was  primarily  a 
“statement  of  faith",  with  aftercare  at  a  later  point  in  time  where  specific 
and  concrete  services  (e.g.  relapse  prevention,  or  couples'  communication 
skills)  are  being  offered.  A  low  aftercare  attendance  rate  may  simply 
reflect  the  subjects'  awareness  of  the  redundant  nature  of  the  early 
relationship  between  aftercare  and  AA.  Why  go  to  aftercare  to  be  told  to  go 
to  AA? 

One  of  the  purposes  of  seeking  out  a  large  data  pool  on  which  to 
conduct  this  analysis  was  the  expectation  of  obtaining  a  more  realistic 
picture  of  the  relationships  between  AA  attendance,  aftercare  and  outcome, 
as  experienced  by  subjects  who  were  not  white,  male,  and  middle-aged,  in 
terms  of  age  and  gender,  this  goal  was  achieved  to  some  degree.  In  terms  of 
ethnic  characteristics,  however,  this  study  provided  some  cause  for 
concern.  The  overwhelming  majority  of  subjects  were  white,  with  no 
substantive  representation  of  other  ethnic  minorities.  This  unanticipated 
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outcome  was  viewed  as  a  significant  limitation  in  terms  of  not  being  able  ; 

to  explore  attendance  patterns  for  different  ethnic  groups. 

The  final  limitation  that  will  be  addressed  is  to  simply  restate  the  ; 

point  that  the  subjects  in  this  study  are  clearly  not  representative  of  the  j 

experiences  of  alcoholics  in  general.  As  previously  discussed,  the  majority 
of  alcoholics  never  go  through  treatment.  Only  a  small  percent  of  alcoholics 
ever  use  AA.  The  results  of  this  study  are  based  on  a  very  selective  sample 
of  alcoholics  who  had  completed  treatment,  agreed  to  participate  in  fairly  ; 

intensive  follow-up  for  two  years,  and  for  whom  all  data  were  successfully  J 

gathered.  Within  this  group,  approximately  50%  attended  AA  and  a  much  ; 

smaller  proportion  attended  aftercare.  From  this  perspective,  the  Issue  of  j 

s 

generalization  of  findings  to  other  groups,  not  directly  comparable  to  the  J 

specified  characteristics  of  the  study  sample,  would  be  moot.  \ 

) 

t 
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Future  research  will  be  required  to  determine  If  the  relationships 
among  variables  identified  in  this  study  can  be  substantiated  when  applied 
to  other  populations.  Much  of  "what  we  know"  about  alcoholism  treatment 
has  been  developed  on  samples  of  indigent,  middle-aged  males  treated  in 
public  facilities.  This  study  serves  a  purpose  of  underscoring  the  relative 
nature  of  our  knowledge  regarding  alcoholism  treatment.  The  relatively 
high  levels  of  sobriety  and  AA  attendance  reported  by  a  broad  spectrum 
sample  of  working  class  and  middle  class  subjects  stand  in  contrast  to  the 
generally  negative  pictures  presented  In  other  studies  which  explored  the 
same  variables  in  samples  drawn  from  state  hospitals  and  VA  hospitals. 

The  absence  of  substantive  representation  of  other  ethnic  groups,  as 
noted  above,  was  both  unexpected  and  a  limitation  in  terms  of  understanding 
"non-white"  groups  attendance  of  aftercare  and  AA.  While  it  was  recognized 
that  a  sizable  percentage  of  the  sample  was  drawn  from  the  upper  Midwest 
which  has  a  larger  proportion  of  whites  than  some  other  areas  of  the 
country,  it  was  felt  that  other  ethnic  groups  were  significantly 
underrepresented  In  this  sample.  The  absence  of  a  significant  minority 
presence  in  this  sample,  given  what  we  know  about  the  relative  prevalence 
of  chemical  dependency  problems  among  minority  groups,  suggests  that  the 
earlier  identified  concerns  about  minority  access  to  treatment  continue  to 
be  a  relevant  topic. 

The  Incidental  finding  that  the  minority  representation  in  this  sample 
was  only  5ft,  calls  In  to  question  the  positive  conclusion  expressed  by  HHS 


J.V.y  ♦*(.  J  .  f  »4l£*« 


Trrw^vwirwwh  winiy 


t  JWWgTOTCT  PSEf  BTa  WW^JW  *:  ^  qpw  W  77.wjw  m. . 


215 

Secretary  Bowen  in  the  Sixth  Special  Report  to  the  U.S.  Congress  on  Alcohol 
and  Health  "that  continuing  attention  is  being  paid  to  the  heterogeneity 
apparent  among  alcoholics'*  (1987,  p.  136).1  Perhaps  unfairly,  It  would  seem 
that  the  minority  representation  continues  to  be  more  evident  In  the 
Increased  emphasis  on  the  collection  of  morbidity  and  mortality  statistics, 
than  it  does  in  the  treatment  outcome  statistics. 

The  singular  contribution  of  AA  attendance  towards  the  explanation 
of  the  variance  in  sobriety  lends  support  to  the  efficacy  of  referring  clients 
to  AA  upon  their  discharge  from  treatment.  Subjects  who  attended  AA  had 
a  demonstrable  Improvement  In  their  sobriety  rates  when  compared  with 
those  who  did  not  attend  AA.  The  cross-lagged  panel  analysis  of  the 
relationship  between  AA  attendance  and  sobriety  underscores  the 
importance  of  this  relationship.  While  the  data  suggested  that,  to  a  degree, 
sobriety  may  reinforce  AA  attendance,  the  reinforcing  effect  of  AA 
attendance  on  sobriety  was  more  important. 

Of  equal  Importance  was  the  recognition  that  a  sizable  proportion  of 
the  study  sample  were  able  to  maintain  their  sobriety  without  having  to 
attend  either  AA  or  aftercare.  AA  attendance  was  useful  to  some,  but  not 
all  of  the  subjects.  The  data  support  the  Idea  that  the  referral  to  AA  needs 
to  be  tempered  with  the  observation  that  there  are  alternative  routes  to  the 
achievement  of  sobriety.  Certainly  the  data  bring  into  question  the  heavy 
emphasis  currently  being  placed  by  some  treatment  centers  and  staff  on  the 
absolute  necessity  of  AA  attendance  for  the  maintenance  of  sobriety. 


1  In  fairness  to  Secretary  Bowen,  It  should  be  noted  that  his  comments  were  more  directed  to  the 
diversity  of  diagnostic  categories  than  to  the  Issues  regarding  selective  access  to  treatment  of 
various  ethnic  and  minority  groups.  The  problem  of  access  to  treatment  continues  to  be  an 
Important  Issue  about  which  both  clinicians  and  researchers  should  be  cognizant. 
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The  problems  with  the  construct  of  aftercare  experienced  In  this 
study  served  to  limit  the  significance  of  the  findings.  However,  the  absence 
of  a  substantive  relationship  between  aftercare  and  sobriety  is  an 
important  finding  which  bears  further  consideration.  As  suggested  earlier 
In  this  chapter,  the  Issue  may  have  more  to  do  with  the  state  of  the  art  than 
whether  or  not  aftercare  Is  an  essential  element  In  the  recovery  process.  In 
other  health  related  fields,  aftercare  programs  have  been  able  to 
demonstrate  their  efficacy. 

Presently,  this  data  would  support  the  recommendations  of  increasing 
the  commitment  of  resources  for  research  into  aftercare,  while  tightening 
the  focus  of  program  emphasis  around  more  specific  and  concrete  service 
delivery  options.  Clearly  the  data  from  this  study  support  the  observation 
that  aftercare  programing  must  offer  additional  services  beyond  the 
traditional  referral  or  reminder  to  attend  AA  In  order  to  be  utilized  by  a 
greater  number  of  clients. 
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It  is  with  some  Irony  that  the  author  notes  that  In  undertaking  this 
study  for  the  purpose  of  fulfilling  the  requirements  of  a  Ph.D.  program  in 
social  work  that  he  found  himself  working,  for  the  most  part  outside  of  the 
field.  Surveying  the  literature  In  the  chemical  dependency  field  one  can 
come  away  with  the  mistaken  Impression  that  the  chemical  dependency 
field  is  the  sole  purview  of  psychology  and  psychiatry.  Of  the  hundreds  of 
books  and  articles  reviewed  for  this  project  only  a  handful  were  written  by 
social  workers,  while  a  few  more  listed  social  workers  as  third  or  fourth 


authors. 


On  the  other  hand,  when  one  looks  at  the  staffing  of  chemical 
dependency  treatment  facilities,  social  workers  can  frequently  be  found  in 


both  clinical  and  administrative  positions.  One  measure  of  the  importance 


of  the  contribution  of  social  work  to  the  chemical  dependency  field  can  be 
found  In  the  U.S.  Air  Force,  which  prefers  that  Its  alcoholism  treatment 


center  directors  be  Ph.D.  social  workers  and  its  assistant  directors  be  MSW 


social  workers.  Thus,  while  social  work  Is  visible  In  the  provision  of 


services,  Its  absence  Is  quite  noticeable  In  the  research  component  upon 


which  many  treatment  decisions  are  ultimately  based. 

Earlier  In  this  study,  the  author  noted  the  absence  of  an  organizing 
theoretical  perspective  which  could  serve  to  draw  together  the  disparate 
and  often  contradictory  findings  identified  in  the  treatment  outcome 
literature.  In  this  regard  social  work  is  perhaps,  uniquely  situated  to  offer 
guidance  through  Its  long  standing  appreciation  of  the  person-situation 
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duality.  Recent  developments  In  the  search  for  models,  of  which  Germain 


and  Gltterman's  (1980)  life  model  Is  perhaps  most  notable,  have  provided 
conceptual  frameworks  with  which  to  approach  the  complexity  of  chemical 
dependency  problems  from  a  social  work  perspective. 


The  point  being  made  is  that  the  profession  of  social  work  has 
historically  focused,  at  the  level  of  service  delivery,  on  the  very  problems 
which  repeatedly  confound  the  researcher  who  Is  attempting  to  make  sense 
of  the  multidimensional  aspects  of  chemical  dependency  problems.  On  the 
other  hand,  until  recently  the  majority  of  social  workers  in  the  chemical 
dependency  field  have  not  had  either  the  Interest  or  the  training  to  utilize 
the  varied  research  tools  which  could  help  to  sort  out  real  treatment 
effects  from  app  iling  but  often  spurious  effects. 

This  dissertation,  In  some  respects,  confirms  the  fluidity  of  our 
knowledge  regarding  chemical  dependency  Issues.  Assumptions  regarding 
the  inevitability  of  poor  outcomes,  based  on  observations  of  chronic 
inebriates,  must  be  be  tempered  by  the  more  positive  outcomes  observed  in 
this  study  which  was  based  on  a  sample  of  higher  functioning  subjects. 
Perhaps  the  poor  performance  In  the  former  group  is  more  a  function  of 
access  to  resources  than  solely  due  to  the  effects  of  the  problems 
themselves. 

The  lack  of  fit  In  terms  of  a  model  which  ties  together  issues  of 
sobriety  with  other  measures  of  successful  functioning  speaks  clearly  to 
the  need  to  look  beyond  the  traditional  research  focus  on  Individual  or 
intrapersonal  characteristics  associated  with  chemical  dependency 
problems.  The  earlier  reported  observation  by  Cronklte  and  Moos  ( 1 980) 
about  the  contribution  of  posttreatment  experiences  suggest  that  chemical 
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dependency  problems  must  also  be  viewed  as  social  problems  in  addition  to 
looking  at  them  in  terms  of  their  physical  and  psychological  components. 

This,  however,  will  probably  not  occur  unless  social  work,  as  a 
profession,  takes  more  of  an  interest  in  contributing  to  knowledge  building 
within  the  chemical  dependency  field.  The  continuation  of  status  quo 
treatment  practices  in  the  presence  of  research  data  which  questions  their 
efficacy,  without  seeking  further  understanding,  is  in  some  respects 
unethical  professional  behavior.  It  Is  Incumbent  upon  the  profession  to 
develop  the  requisite  skills  to  become  more  active  participants  in  the 
search  for  knowledge  and  to  make  use  of  the  social  work  perspective  in  the 
development  of  research  designs  which  further  the  explication  of  chemical 
dependency  problems. 


This  study  has  focused  on  the  relationship  between  AA  attendance, 
aftercare,  and  their  relationships  to  measures  of  outcome  functioning.  The 
data  analysis  suggested  that,  for  this  sample,  the  two  test  variables  were 
not  related  to  the  majority  of  outcome  measures.  AA  attendance  was  found 
to  be  related  to  sobriety,  although  the  majority  of  variance  In  sobriety 
remained  to  be  explained.  Aftercare  may  have  been  confounded  with  mental 
health  treatment.  The  relationship  between  aftercare  and  sobriety  was 
minimal,  with  most  of  the  relationship  being  accounted  for  by  the 
interaction  between  AA  attendance  and  aftercare.  The  control  variables 
chosen  for  inclusion  In  this  study  were  weakly  related  to  both  the  test 
variables  and  the  outcome  variables. 

The  general  absence  of  significant  relationships  in  this  study  is  cause 
for  concern.  One  conclusion  to  be  drawn  from  these  findings  was  that  there 
was.  In  fact,  very  little  relationship  among  the  variables  examined  In  this 
study.  This  conclusion,  however,  contradicts  what  has  been  previously 
demonstrated  In  other  studies.  A  more  appropriate  conclusion  might  be  to 
suggest  that  the  model  which  generated  the  study  was  not  very  effective  in 
terms  of  describing  the  relationships  among  variables.  The  limited  findings 
of  this  study  can  be  viewed  as  important  clues  to  the  construction  of  an 
alternative  model  which  might  provide  a  more  effective  means  of 
explicating  the  relationships  among  the  study  variables. 

The  model  (see  Figure  1 )  which  prompted  the  Initial  Interest  In  this 
study  was  based,  for  the  most  part,  on  a  review  of  the  literature  and 
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clinical  intuition.  The  model  presented  in  Figure  5  attempts  to  combine  the 
original  model,  grounded  In  theory,  with  the  results  of  the  secondary  data 
analysis.  The  central  feature  of  the  new  model,  conceptualizes  sobriety  as 
an  Intermediate  variable,  which  In  turn,  may  influence  outcome.  In  addition 
to  AA  and  aftercare,  mental  health  treatment  was  seen  as  a  viable  referral 
option  for  clients  completing  chemical  dependency  treatment.  Figure  6 
demonstrates  that  this  model  may  be  further  expanded  by  combining  it  with 
Cronklte  and  Moos  (1980)  concepts  of  postreatment  functioning. 

This  new  model  would  require  more  sophisticated  data  analysis  tools 
than  were  used  in  this  study.  Multiple  regression  analysis  was  limited,  in 
terms  of  Its  ability  to  separate  direct  effects  from  Indirect  effects.  Path 
analysis,  however,  could  effectively  look  at  the  relationship  among  the 
variables,  "decompose  the  causal  and  non-causal  components  of  simple 
correlations",  and  look  at  the  direct  and  Indirect  effects  of  the  variables  on 
each  other  (Costello,  1980,  p.  49). 

A  second  area  warranting  further  study  was  suggested  by  the 
Interviews  of  the  coordinators  of  the  aftercare  programs.  Without 
exception,  each  aftercare  coordinator  felt  their  aftercare  programs  directly 
enhanced  their  clients'  chances  to  remain  sober.  The  anecdotal  comments 
used  to  support  their  positions  were  varied  and  numerous.  Summarized,  the 
interviews  suggested  that  such  elements  as  relapse  prevention,  targeted 
groups,  staffing  levels,  and  alternative  follow-up  procedures  may  have  an 
Influence  on  outcome  which  may  have  been  masked  in  this  study  by  a 
research  design  which  simply  asked  about  attendance  patterns.  The  Index  of 
Intensity  was  an  ex  post  facto  attempt  to  enhance  the  efficacy  of  the 
construct  of  aftercare.  The  absence  of  findings  might  have  simply  been 


related  to  the  manner  in  which  the  construct  was  defined.  The  author  notes 
that  further  explication  of  aftercare  Is  warranted,  with  particular  emphasis 
being  place  on  specific  services  being  offered. 

The  sizable  number  of  this  sample  who  maintained  their  sobriety 
without  attending  AA  or  aftercare  suggested  that  we  have  a  less-than- 
perfect  understanding  of  what  skills,  resources,  and  abilities  are  necessary 
to  maintain  sobriety.  Likewise,  the  role  of  sobriety  vis-a-vis  the  other 
outcome  variables  was  ambiguous.  In  contrast  to  other  studies  which  have 
recommended  less  emphasis  be  placed  on  sobriety,  this  study  would  suggest 
that  exploring  the  dynamics  Involved  in  sobriety  would  be  a  particularly 
germane  research  topic.  What  are  the  factors  which  allow  some  clients  to 
achieve  sobriety  with  relative  ease?  When  is  sobriety  a  relevant  variable  in 
terms  of  outcome  functioning? 

Earlier,  In  the  literature  review,  the  author  noted  the  degree  to  which 
the  operational  definition  of  sobriety  determined,  to  a  large  degree,  the 
outcome  of  the  study.  If  sobriety  was  defined  as  continuous,  never 
Interrupted  sobriety,  the  outcome  results  were  predictably  fairly  dismal. 
Sobriety  was  defined  In  this  study  as  either  being  present  or  absent  (in  the 
bivariate  analyses,  cross-lagged  panel  analyses,  and  discriminant  analyses) 
or  amount  in  terms  of  the  number  of  months  of  sobriety  reported  per 
follow-up  Interval  (In  the  multiple  regressions  of  sobriety).  The  author 
concludes  that  an  appropriately  sensitive  construct  regarding  sobriety  has 
yet  to  be  developed  and  consequently  Is  an  important  topic  for  further  study. 

The  absence  of  substantive  ethnic  representation  raises  a 
parenthetical  concern  regarding  the  accessibility  of  treatment.  One 
assumption  expressed  earlier  In  this  study  was  the  hypothesis  that,  as 


treatment  moved  beyond  the  social  control  issues  regarding  chronic 
inebriates,  the  population  seeking  treatment  would  increasingly  be 
reflective  of  the  demographic  characteristics  of  the  U.S.  population.  What 
factors  are  operating  which  serve  to  limit  the  accessibility  to  treatment? 
What  happens  when  mainstream  America  samples  are  compared  with 
samples  drawn  from  the  traditional  public  conduits  for  research  subjects? 
How  are  chemical  dependency  problems  being  addressed  in  the  ethnic  groups 
which  do  not  appear  in  the  statistics  of  treatment  outcome  studies? 

This  brief  potpourri  of  research  questions  generated  by  this  study 
suggests  that  if  one  chooses  to  look,  there  are  significant  issues  which, 
while  dormant,  are  not  resolved.  The  Ideological  conflict  within  the 
chemical  dependency  treatment  field  has  had  the  effect  of  narrowing  the 
focus  of  topics  considered  appropriate  for  research.  The  high  quality, 
prospective  research  necessary  to  advance  our  understanding  of  the 
relationship  between  AA  attendance,  aftercare,  and  sobriety  cannot  take 
place  In  an  environment  In  which  the  Ideological  boundaries  are  so  rigidly 
established  that  the  resources  are  not  available  to  conduct  the  research. 

This  study  documented  the  importance  of  AA  attendance  for  a  large 
percentage  of  the  sample.  Overall,  an  effect  for  aftercare  could  not  be 
demonstrated.  For  many  subjects,  however,  neither  AA  or  aftercare  were 
necessary  to  successfully  maintain  their  sobriety.  Other  factors  remain  to 
be  discovered  which  contribute  to  the  explanation  of  the  variance  in 
sobriety.  The  relationship  between  sobriety  and  other  outcome  variables  is 
ambiguous.  Clearly  the  model  of  sobriety  generated  by  current  thinking  is 
not  adequate  to  address  the  multldetermlned  aspects  of  many  of  the 
variables  considered  in  this  study. 


In  some  respects  this  study  might  be  considered  to  be  more  of  a 
"multt-cross-sectlonar  design  than  a  longitudinal  study.  The  combination 
of  four  follow-up  Intervals  and  use  of  cross-lagged  panel  analysis  was  an 
attempt  to  bridge  the  gap  between  strictly  cross-sectional  designs  and 
longitudinal  designs.  Another  approach,  however,  might  be  to  consider 
cohort  analysis  and  follow  specific  groups  of  subjects  over  time.  For 
example,  the  cohort  of  first  admissions  compared  with  cohorts  of  multiple 
admissions  might  prove  to  more  clearly  explicate  relationships  among  the 
variables  under  study. 

The  limitations  of  the  ex  post  facto  secondary  data  analysis  design 
may  have  been  reached.  At  some  point  In  the  near  future  the  chemical 
dependency  field  is  going  to  have  to  take  a  hard  look  at  the  rationale  which 
discourages  experimental  designs.  Much  of  the  ambiguity  regarding  the 
relationships  among  variables  In  this  field  could  be  resolved  by  a 
prospective  and  longitudinal  experimental  research  design.  The  problem, 
however,  may  be  that  the  Improved  capacity  to  address  chemical  dependency 
Issues  may  come  at  the  expense  of  one  or  more  Ideological  sacred  cows. 
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Note:  The  question  number  in  parentheses  refers  to  the  number  of  the  item 
as  It  was  listed  on  the  CATOR-1 1 1  forms:  For  example,  AA  Attendance  was 
Identified  as  F-17,  indicating  that  it  was  the  17th  item  on  the  Follow-up 
form. 

F=  follow-up  (separate  follow-up  form  for  6,12,18,  and  24  months) 
D=  Discharge  Checklist 
I  *  CATOR-III  Intake 
H  ■  CATOR-1 1 1  History 


A.  AA  Attendance  (F- 1 7):  How  often  do  you  attend  AA  meetings? 

( 1 ) .  I  do  not  attend 

(2) .  once  a  month  or  less 

(3) .  several  times  a  month 

(4) .  once  a  week  or  more 

B.  Aftercare  Attendance  (F- 1 8):  Have  you  attended  any  other  groups? 
(Such  as  "aftercare",  family  group,  support  group,  assertiveness  training, 
etc.) 

(1) .  no 

(2) .  yes 

(3) .  completed 


A.  Age  (calculated  from  the  birth  date  and  date  of  follow-up-  listed 
in  the  identification  section  of  the  CATOR-III  intake  form). 


Form). 


B.  Sex  (listed  in  the  identification  section  of  the  CATOR-III  Intake 

(1) .  male 

(2) .  female 


*  j**  *  * » »  ,U'.V , 


<1  ’,»*VU’ 


C.  Marital  Status  (1-2): 

(1) .  single,  never  married 

(2) .  divorced 

(3) .  separated 

(4) .  widowed 

(5) .  living  with  mate 

(6) .  married 


D.  Ethnicity  (I- 1 ): 

(1) .  White 

(2) .  Hispanic 

(3) .  Black 

(4) .  Native  American 

(5) .  Asian/other 

E.  Years  of  Education  (highest  number  of  years  reported  in  1-3). 

F.  Employability  (Based  on  current  employment  status  as  reported  in 

1-5). 

(1) .  Employable: 

(a) ,  full-time  employment 

(b) .  part-time  employment 

(c) .  unemployed 

(2) .  Not  employable: 

(a) ,  retired/disabled 

(b) .  homemaker 

(c) .  student 

G.  Previous  chemical  dependency  treatment  (exact  number  of  previous 
admissions  recorded  in  H-29). 


> 


H.  Type  of  Substance  (based  on  chemical  usage  reported  in  questions 
H-33  through  H-42). 

(1) .  alcohol  only 

(2) .  drugs  and  alcohol 

(3) .  drugs  other  than  alcohol  only 


\ 


i*.**;  iHV  I?  A  Will1*.  ♦>*  ■  ^i*.  !»*■  h1' 1 ,1  M'Lt  »  J  l*i>l^l<ill|i!llt'l>>,iVll*Vi>«,>UliL!^  y  rrtV»V|^k|*AVi 


A.  Sobriety  (exact  number  of  months  were  reported  In  F-14). 

B.  Full-time  employment  During  the  past  six  months  how  many 
months  have  you  worked  full-time?  (exact  number  of  months  were  reported 
in  F-25). 

C.  Part-time  Employment:  During  the  past  six  months  how  many 
months  have  you  worked  part-time?  (exact  number  of  months  were  reported 
in  F-26). 

D.  Welfare  Assistance:  For  how  many  many  of  the  last  six  months  did 
you  receive  welfare?  (exact  number  of  months  were  reported  in  F-20). 

E.  Disability  Income:  For  how  many  of  the  past  six  months  did  you  get 
disability?  (exact  number  of  months  were  reported  in  F-22). 

F.  Injuries:  During  the  past  six  months  how  many  office  visits  have 
you  made  to  a  doctor  for  injuries?  (exact  number  of  visits  were  reported  in 
F-38). 

G.  Visits  to  ER:  During  the  past  six  months  how  many  times  have  you 
received  services  in  an  emergency  room?  (exact  number  of  times  were 
reported  in  F-37). 

H.  Hospitalized  for  Medical  Problems:  During  the  past  six  months  how 
many  days  were  you  in  a  hospital  for  a  medical  problem?  (exact  number  of 
days  were  reported  in  F-36). 

I.  Hospitalized  for  Emotional  Problems:  During  the  past  six  months 
how  many  days  were  you  in  a  hospital  for  an  emotional  problem?  (exact 
number  of  days  were  reported  in  F-42). 

J.  Misdemeanors:  Arrests  in  the  past  six  months  for  charges  related 
to  chemical  use.  (exact  number  of  misdemeanor  arrests  were  reported  in 
F-58). 

K.  Felonies:  Arrests  in  the  past  six  months  for  charges  related  to 
chemical  use.  (number  of  felony  arrests  were  reported  in  F-59). 
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APPENDIX  B:  PROTOCOL  FOR  INTERVIEWS  WITH 
AFTERCARE  COORDINATORS 

Treatment  Center _ Phone _ 

Contact  Person _ Date _ 

1.  Where  program  housed _ 

1.  Length  of  aftercare  program _ 

2.  staffing _ 

A.  Professional _ 

B.  Paraprofessional _ 

C.  Volunteer _ 

3.  Types  of  counseling  offered 

A.  Individual _ 

B.  Group _ 

C.  Family _ 

D.  Referral _ 

E.  Other _ 

4.  Aftercare  planning  session  prior  to 

discharge _ 

6.  Follow-up  contact _ 

7.  Estimate  percent  of  population 

available  for  aftercare _ 

8.  Strong  point  of  program _ 

9.  Different  from  other  programs _ 


10.  Other. 


2  POSSIBLE  POINTS 


15  8  20  12  14  11  18  12 


The  nuiTiters  refer  ■  to  treatment  center  codes.  Per  agreement  with  CATOR ,  no  identifying 
Information  was  to  be  used  in  this  study.  Further  inquires  should  be  addressed  to: 

Dr.  Norman  G.  Hoffmann,  Executive  Director 
CATOR-  Suite  420 
1 7  West  Exchange  Street 
St.  Paul  ,MN  55 102 


1  *.i  «./«.* 


Points 


1.  Length  of  Aftercare-. 

1  -  5  months 
6-  1 1  months 

1  year 

2  years 

2.  Services  offered: 

group 

individual 

family 

special  groups 

3.  Staffing 

professional 

paraprofessional 

volunteer 

4.  Record  Keeping 

attendance 

progress 

summary 

5.  Referral  Process 

written  care  plan 
formal  referral 
formal  follow-up 


6.  Return  visit  program  1 


I  1 
1  1 
1  1 


1  1 


1  1 
1  1 


1  1 


Intensity 

‘X  8-  12) 

Moderate  Intensity 
(Index  13-15) 

High  Intensity 
(Index  17-  20) 

L 

P 

rZ 

70’ 

10 

1 10 

& 

\ 

.U  ■ 

130 

310 

420 

* 

330 

649 

810 

3 

430 

830 

850 

**r- 

640 

820 

910 

Pi 

aS 

► 

*  j 

1  The  numbers  refer  to  treatment  center  codes.  Per  agreement  with  CATOR ,  no  identifying 
information  was  to  be  used  in  this  study.  Further  inquires  should  be  addressed  to: 


Dr.  Norman  G.  Hoffmann,  Executive  Director 
CATOR-  Suite  420 
1 7  West  Exchange  Street 
St.  Paul.MN  55102 
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18  MONTHS 
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CONTROL  VARIABLES 

CHI  SQUARE 

(DF) 

CRAMER1?  Y 

1.  AGE 

75.56 

(64) 

0.160 

,  J 

S 

2.  GENDER 

5.24 

(2) 

0.042 

«»■ 

3,  MARITAL  STATUS 

15.41 

(15) 

0.042 

V 

4.  ETHNICITY 

32.48 

(12) 

0.061 

5.  EMPLOYABILITY 

7.34 

(2) 

0.050 

6.  PRIOR  CD  TX 

62.70 

(39) 

0.085 

■I" 

7.  TYPE  OF  SUBSTANCE 

4.23 

(2) 

0.038 

8.  EDUCATION 

49.08 

(24) 

0.133 

■  ' 

24MQNIH? 


CONTROL  VARIABLES 

CHI  SQUARE 

(DF) 

CRAMER1 

1.  AGE 

99.19 

(64) 

0.184 

2.  GENDER 

5.85 

(2) 

0.045 

3.  MARITAL  STATUS 

16.14 

(15) 

0.043 

4.  ETHNICITY 

8.19 

(12) 

0.030 

5.  EMPLOYABILITY 

7.23 

(2) 

0.049 

6.  PRIOR  CD  TX 

59.78 

(39) 

0.083 

7.  TYPE  OF  SUBSTANCE 

5.48 

(2) 

0.038 

8.  EDUCATION 

52.35 

(.24) 

0.137 

|  wmrwi  TnrvinuLL^ 

j  1.  AGE 

v/m 

115.74 

(64) 

i  2.  GENDER 

11.24 

(2) 

0.0 

62 

3.  MARITAL  STATUS 

24.65 

(10) 

0.0 

65 

4.  ETHNICITY 

6.90 

(8) 

0.0 

34 

5.  EMPLOYABILITY 

17.03 

(2) 

0.0 

77 

1  6.  PRIOR  CD  TX 

11.85 

(39) 

0.0 

46 

i  7.  TYPE  OF  SUBSTANCE 

20.69 

(2) 

0.0 

85 

X  8.  EDUCATION 

32.04 

(24) 

0.107 

18  MONTHS 


CONTROL  VARIABLES 

CHI  SQUARE 

Mi 

CRAMERI? 

1.  AGE 

72.02 

(64) 

0.156 

2.  GENDER 

30.87 

(2) 

0.102 

3.  MARITAL  STATUS 

16.74 

(15) 

0.054 

4.  ETHNICITY 

13.32 

(8) 

0.048 

5.  EMPLOYABILITY 

3.06 

(2) 

0.032 

6.  PRIOR  CD  TX 

23.56 

(39) 

0.064 

7.  TYPE  OF  SUBSTANCE 

23.19 

(2) 

0.090 

8.  EDUCATION 

45.57 

(24) 

0.132 

24  MONTHS 


CONTROL  VARIABLE? 

CHI-SQUARE 

(DF) 

CRAMER' 

1.  AGE 

81.43 

(64) 

0.166 

2.  GENDER 

32.76 

(2) 

0.106 

3.  MARITAL  STATUS 

9.54 

(15) 

0.040 

4.  ETHNICITY 

3.10 

(8) 

0.023 

5.  EMPLOYABILITY 

1.80 

(2) 

0.025 

6.  PRIOR  CD  TX 

20.74 

(39) 

0.060 

7.  TYPE  OF  SUBSTANCE 

27.87 

(2) 

0.099 

8.  EDUCATION 

48.44 

_ 1211 _ 

0.132 

APPENDIX  E3:  AA  ATTENDANCE  BY  OUTCOME  VARIABLES 


6-MONTHS 


1 2  MONTHS 


OUTCOME  VARIABLES 

SIGNIFICANCE  OFF-TEST 

MULTIPIER 

1.  FULL-TIME  EMPLOYMENT 

0.342 

0.034 

2.  PART-TIME  EMPLOYMENT 

0.690 

0.023 

3.  WELFARE  ASSISTANCE 

0.362 

0.033 

4.  DISABILITY  ASSISTANCE 

0.941 

0.012 

5.  HOSPITALIZED  MED.  PROB. 

0.019 

0.059 

6.  VISITS  TO  ER 

0.978 

0.008 

7.  INJURIES 

0,031 

0.056 

8.  HOSPITALIZED  EMOT.  PROB. 

0.690 

0.023 

9.  MISDOMEANORS 

0.063 

0.050 

10.  FELONIES 

0.013 

0.061 

11.  SOBRIETY 

0.001 

0.264 

OUTCOME  YARIA6i.ES 

SIGNIFICANCE  OFF-TEST 

MULUELER 

1.  FULL-TIME  EMPLOYMENT 

0.002 

0.071 

2.  PART-TIME  EMPLOYMENT 

0.937 

0.012 

3.  WELFARE  ASSISTANCE 

0.170 

0.042 

4.  DISABILITY  ASSISTANCE 

0.092 

0.047 

5.  HOSPITALIZED  MED.  PROB. 

0.269 

0.037 

6.  VISITS  TO  ER 

0.406 

0.032 

7.  INJURIES 

0.001 

0.083 

8.  HOSPITALIZED  EMOT,  PROB. 

0.732 

0.021 

9.  MISDOMEANORS 

0.147 

0.043 

10.  FELONIES 

0.097 

0.047 

11.  SOBRIETY 

0.001 

0.317 

A-va'a V 'V 


■UUMMS 


1. 

FULL-TIME  EMPLOYMENT 

0.483 

0.029 

2. 

PART-TIME  EMPLOYMENT 

0.258 

0.037 

3. 

WELFARE  ASSISTANCE 

0.746 

0.021 

4. 

DISABILITY  ASSISTANCE 

0.267 

0.037 

5. 

HOSPITALIZED  MED.  PROB. 

0.775 

0.020 

6. 

VISITS  TO  ER 

0.851 

0.017 

7. 

INJURIES 

0.232 

0.038 

8. 

HOSPITALIZED  EMOT.  PROB. 

0.197 

0.040 

9. 

MISDOMEANORS 

0.852 

0.016 

10.  FELONIES 

0.820 

0.018 

11 

.  SOBRIETY 

0.001 

0.317 

i 


» 


1.  FULL-TIME  EMPLOYMENT 

0.017 

0.059 

2.  PART-TIME  EMPLOYMENT 

0.429 

0.031 

3.  WELFARE  ASSISTANCE 

0.890 

0.015 

4.  DISABILITY  ASSISTANCE 

0.768 

0.020 

5.  HOSPITALIZED  MED.  PROB. 

0.310 

0.035 

6.  VISITS  TO  ER 

0.507 

0.028 

7.  INJURIES 

0.408 

0.032 

8.  HOSPITALIZED  EMOT.  PROB. 

0.242 

0.038 

9.  MISDOMEANORS 

0.356 

0.034 

10.  FELONIES 

0,015 

0.060 

11.  SOBRIETY 

0.001 

0.308 

1.  FULL-TIME  EMPLOYMENT 

2.  PART-TIME  EMPLOYMENT 

3.  WELFARE  ASSISTANCE 

4.  DISABILITY  ASSISTANCE 

5.  HOSPITALIZED  MED.  PROB. 

6.  VISITS  TO  ER 

7.  INJURIES 

8.  HOSPITALIZED  EMOT.  PROB. 

9.  MISDOMEANORS 

10.  FELONIES 

11.  SOBRIETY 


1.  FULL-TIME  EMPLOYMENT 

2.  PART-TIME  EMPLOYMENT 

3.  WELFARE  ASSISTANCE 

4.  DISABILITY  ASSISTANCE 

5.  HOSPITALIZED  MED.  PROB. 

6.  VISITS  TO  ER 

7.  INJURIES 

8.  HOSPITALIZED  EMOT.  PROB. 

9.  MISDOMEANORS 

10.  FELONIES 

11.  SOBRIETY 


Time  Period 
06  months 

Eigenvalue 

0.073 

Canonical  Correlation 
0.262 

Wilks  Lambda 
0.931 

Sifl 

0.0000 

1 2  months 

0.106 

0.309 

0.904 

0.0000 

1 8  months 

0.098 

0.299 

0.911 

0.0000 

24  months 

0.099 

0.300 

0.910 

0.0000 

Variables  included  in  the  Discriminant  Function1 


6  months 

12  months 

18  months 

24  months 

Prior  Tx 

Ethnicity 

Age 

Age 

Ethnicity 

Employability 

Sex 

Education 

AA 

Age 

Prior  Tx 

Sex 

Aftercare 

Prior  Tx 

Ethnicity 

Employability 

Sex 

Employability 

Prior  Tx 

Education 

Education 

Ethnicity 

AA 

Aftercare 

AA 

AA 

’Control  variables  were  entered  as  a  group,  followed  by  AA  and  then  aftercare. 


